Sep 09 15:51:28.624682 ip-10-0-135-66 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 15:51:29.021737 ip-10-0-135-66 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 15:51:29.021737 ip-10-0-135-66 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 15:51:29.021737 ip-10-0-135-66 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 15:51:29.021737 ip-10-0-135-66 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 15:51:29.021737 ip-10-0-135-66 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 15:51:29.022456 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.021755    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 15:51:29.026523 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026498    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:51:29.026523 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026518    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:51:29.026523 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026522    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:51:29.026523 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026525    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:51:29.026523 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026528    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:51:29.026523 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026532    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026535    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026538    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026541    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026544    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026547    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026550    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026553    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026556    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026558    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026561    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026564    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026567    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026570    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026573    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026575    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026578    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026580    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026583    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026586    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:51:29.026752 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026588    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026591    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026593    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026596    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026598    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026601    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026603    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026617    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026620    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026623    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026625    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026628    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026630    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026634    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026637    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026640    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026644    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026648    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026651    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026655    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:51:29.027236 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026658    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026660    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026664    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026666    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026669    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026672    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026675    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026677    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026679    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026682    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026684    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026687    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026689    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026692    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026694    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026696    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026699    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026701    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026704    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:51:29.027790 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026707    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026710    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026715    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026719    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026723    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026726    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026729    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026734    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026740    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026743    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026746    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026748    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026751    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026753    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026757    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026760    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026762    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026765    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026768    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:51:29.028262 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026772    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026775    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026778    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026780    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026783    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026785    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026788    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026791    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026793    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026796    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026799    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026801    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026804    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026806    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026809    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.026811    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027562    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027570    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027573    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027576    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:51:29.028743 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027580    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027582    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027585    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027588    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027590    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027593    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027595    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027598    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027600    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027603    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027605    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027608    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027610    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027614    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027616    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027620    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027622    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027625    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027628    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027630    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:51:29.029225 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027633    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027636    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027639    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027641    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027644    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027646    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027649    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027651    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027654    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027656    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027659    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027663    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027666    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027669    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027672    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027675    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027677    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027680    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027683    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:51:29.029758 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027685    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027688    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027691    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027693    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027696    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027698    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027700    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027703    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027707    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027709    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027712    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027714    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027717    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027719    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027722    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027724    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027727    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027730    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027732    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:51:29.030271 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027735    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027740    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027743    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027746    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027749    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027752    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027755    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027758    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027761    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027766    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027769    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027772    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027776    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027778    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027782    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027784    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027787    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027790    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027793    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:51:29.030751 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027796    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027798    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027802    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027805    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027808    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027811    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027813    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027816    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027819    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027822    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027826    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027828    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027831    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027833    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027836    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027841    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027844    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.027846    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028246    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028251    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:51:29.031224 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028254    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028257    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028260    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028263    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028266    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028268    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028272    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028275    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028278    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028280    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028283    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028286    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028289    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028291    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028294    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028297    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028300    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028302    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028305    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:51:29.031748 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028307    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028310    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028312    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028315    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028318    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028320    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028323    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028325    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028328    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028331    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028333    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028336    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028339    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028341    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028344    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028360    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028363    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028366    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028368    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028371    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:51:29.032231 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028373    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028376    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028378    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028382    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028386    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028388    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028391    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028394    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028397    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028399    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028402    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028404    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028407    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028409    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028412    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028415    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028417    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028420    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028422    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028425    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:51:29.032737 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028428    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028430    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028433    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028436    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028438    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028442    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028444    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028448    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028452    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028455    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028458    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028461    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028464    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028467    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028469    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028472    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028475    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028477    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028480    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:51:29.033251 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028482    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028487    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028490    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028493    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028495    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028497    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028500    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028503    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028505    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028508    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028511    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028513    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028516    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028518    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028521    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028524    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028526    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028529    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.028531    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028606    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028655    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 15:51:29.033816 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028663    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028668    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028672    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028676    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028680    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028685    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028688    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028691    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028694    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028698    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028701    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028704    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028707    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028710    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028717    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028721    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028724    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028727    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028731    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028737    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028740    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028744    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028747    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 15:51:29.034336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028751    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028754    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028758    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028761    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028764    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028767    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028770    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028774    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028777    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028780    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028783    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028786    2578 flags.go:64] FLAG: --enable-server="true"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028789    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028794    2578 flags.go:64] FLAG: --event-burst="100"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028797    2578 flags.go:64] FLAG: --event-qps="50"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028799    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028802    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028805    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028809    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028812    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028815    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028818    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028821    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028823    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028827    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 15:51:29.034914 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028830    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028833    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028836    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028841    2578 flags.go:64] FLAG: --feature-gates=""
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028845    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028848    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028851    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028854    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028859    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028862    2578 flags.go:64] FLAG: --help="false"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028865    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028869    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028872    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028875    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028878    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028882    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028885    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028888    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028890    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028893    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028896    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028899    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028902    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028905    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 15:51:29.035584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028908    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028911    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028914    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028916    2578 flags.go:64] FLAG: --lock-file=""
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028919    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028922    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028925    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028930    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028934    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028937    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028948    2578 flags.go:64] FLAG: --logging-format="text"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028952    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028956    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028959    2578 flags.go:64] FLAG: --manifest-url=""
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028962    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028966    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028970    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028974    2578 flags.go:64] FLAG: --max-pods="110"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028977    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028980    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028983    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028986    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028989    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028992    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.028995    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 15:51:29.036178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029002    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029005    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029008    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029011    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029014    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029019    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029022    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029025    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029028    2578 flags.go:64] FLAG: --port="10250"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029031    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029034    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0edbf022aa04f5277"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029037    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029040    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029043    2578 flags.go:64] FLAG: --register-node="true"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029046    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029050    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029053    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029056    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029061    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029065    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029068    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029071    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029073    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029076    2578 flags.go:64] FLAG: --runonce="false"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029080    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 15:51:29.036806 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029083    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029086    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029089    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029092    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029095    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029098    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029101    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029104    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029107    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029110    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029112    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029115    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029118    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029121    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029126    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029128    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029131    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029138    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029140    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029143    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029146    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029149    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029152    2578 flags.go:64] FLAG: --v="2"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029155    2578 flags.go:64] FLAG: --version="false"
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029163    2578 flags.go:64] FLAG: --vmodule=""
Sep 09 15:51:29.037463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029168    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029171    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029287    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029291    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029293    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029296    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029300    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029303    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029305    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029308    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029311    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029314    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029316    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029319    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029322    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029324    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029327    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029329    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029332    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029334    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:51:29.038075 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029337    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029343    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029360    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029364    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029368    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029372    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029376    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029379    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029382    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029385    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029388    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029390    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029396    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029399    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029402    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029404    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029407    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029409    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029414    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:51:29.038590 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029417    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029420    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029422    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029425    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029427    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029430    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029433    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029435    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029438    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029440    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029443    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029445    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029448    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029451    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029453    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029457    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029461    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029464    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029468    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:51:29.039062 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029471    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029474    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029477    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029480    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029483    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029485    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029489    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029499    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029501    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029504    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029506    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029509    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029512    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029515    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029518    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029521    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029523    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029526    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029528    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029531    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:51:29.039596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029534    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029537    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029539    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029542    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029546    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029549    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029552    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029555    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029558    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029561    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029564    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029566    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029569    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029572    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029575    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029578    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029581    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029583    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029588    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029611    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:51:29.040103 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029620    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029624    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.029626    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.029634    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.037149    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.037167    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.037933    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.037941    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038024    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038028    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038032    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038035    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038038    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038040    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038043    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:51:29.040619 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038046    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038049    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038052    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038055    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038058    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038061    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038063    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038066    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038068    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038071    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038073    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038076    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038079    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038081    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038084    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038087    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038090    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038094    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038098    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038101    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:51:29.041015 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038104    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038107    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038116    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038119    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038122    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038125    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038128    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038131    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038133    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038136    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038139    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038142    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038144    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038147    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038150    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038153    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038156    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038158    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038161    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038163    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:51:29.041516 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038166    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038169    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038171    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038174    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038176    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038179    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038182    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038185    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038187    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038190    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038192    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038195    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038197    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038200    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038203    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038212    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038215    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038217    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038220    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038222    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:51:29.042002 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038224    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038228    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038232    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038235    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038238    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038240    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038243    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038246    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038250    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038253    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038256    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038258    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038261    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038263    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038266    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038268    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038271    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038274    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038277    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:51:29.042502 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038280    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038282    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038284    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038287    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038291    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038293    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038296    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038298    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038301    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038309    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038312    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038314    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038317    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.038322    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038476    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 15:51:29.043007 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038483    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038486    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038489    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038492    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038494    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038497    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038500    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038517    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038520    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038524    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038527    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038530    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038533    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038535    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038538    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038541    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038544    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038547    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038549    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038552    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 15:51:29.043392 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038554    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038557    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038560    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038562    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038565    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038568    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038570    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038578    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038581    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038584    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038587    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038589    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038592    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038595    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038597    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038600    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038604    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038608    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038610    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 15:51:29.043883 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038613    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038616    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038619    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038622    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038625    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038627    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038630    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038633    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038636    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038638    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038641    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038643    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038646    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038649    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038651    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038654    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038657    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038661    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038664    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 15:51:29.044356 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038667    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038669    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038678    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038680    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038684    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038687    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038690    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038693    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038696    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038698    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038701    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038703    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038706    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038708    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038711    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038713    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038716    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038718    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038721    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038723    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 15:51:29.044859 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038726    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038729    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038731    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038734    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038736    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038739    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038741    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038744    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038747    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038749    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038752    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038755    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038757    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038760    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038762    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038770    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038773    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038776    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038778    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 15:51:29.045377 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:29.038780    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.038785    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.038934    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.041051    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.042037    2578 server.go:1019] "Starting client certificate rotation"
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.042136    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.042737    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 15:51:29.045840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.044622    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 15:51:29.048266 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.048151    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 15:51:29.060019 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.059994    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 09 15:51:29.064626 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.064609    2578 log.go:25] "Validated CRI v1 image API"
Sep 09 15:51:29.065477 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.065448    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 15:51:29.067920 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.067897    2578 fs.go:135] Filesystem UUIDs: map[431d2ad6-7877-442b-9fbd-e49a78b64773:/dev/nvme0n1p3 705e0812-484b-4a9a-8525-d165a1fbf841:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 09 15:51:29.068014 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.067919    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 15:51:29.073488 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.073467    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 15:51:29.074234 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.074114    2578 manager.go:216] Machine: {Timestamp:2026-09-09 15:51:29.072002013 +0000 UTC m=+0.333131181 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100145 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec285425db93e03b0f52a8f0e213b457 SystemUUID:ec285425-db93-e03b-0f52-a8f0e213b457 BootID:c99eb945-70bb-4176-b680-8c20176edca0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:03:5b:9f:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:03:5b:9f:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:f5:3a:b0:36:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 15:51:29.074326 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.074236    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 15:51:29.074393 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.074381    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 15:51:29.077731 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.077701    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 15:51:29.077892 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.077734    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 15:51:29.078495 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.078484    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 15:51:29.078534 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.078496    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 15:51:29.078534 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.078504    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 15:51:29.079216 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.079206    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 15:51:29.080464 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.080453    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 15:51:29.083493 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083480    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 15:51:29.083619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083609    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 15:51:29.083656 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083649    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 15:51:29.083685 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083664    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 15:51:29.083747 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083737    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 15:51:29.083780 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083760    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 09 15:51:29.083780 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.083776    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 15:51:29.084251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.084234    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 15:51:29.084307 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.084256    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 15:51:29.086440 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.086424    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 15:51:29.088667 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088647    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 15:51:29.088742 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088689    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 15:51:29.088961 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088947    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 15:51:29.089023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088967    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 15:51:29.089023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088976    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 15:51:29.089023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088984    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 15:51:29.089023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.088996    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 15:51:29.089023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089004    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 15:51:29.089403 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089392    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 15:51:29.089463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089405    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 15:51:29.089463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089415    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 15:51:29.089463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089434    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 15:51:29.089463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089452    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 15:51:29.089463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.089463    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 15:51:29.090793 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.090783    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 15:51:29.090852 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.090795    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 15:51:29.094210 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.094191    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wn6rf"
Sep 09 15:51:29.094840 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.094822    2578 server.go:1268] "Started kubelet"
Sep 09 15:51:29.095095 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.095063    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 15:51:29.095187 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.095087    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 15:51:29.095187 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.095110    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 15:51:29.095187 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.095122    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 15:51:29.095335 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.095207    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 15:51:29.095898 ip-10-0-135-66 systemd[1]: Started Kubernetes Kubelet.
Sep 09 15:51:29.096322 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.096301    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 15:51:29.098512 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.098021    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 15:51:29.098631 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.098617    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 15:51:29.100622 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.100601    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 15:51:29.102511 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.101562    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-66.ec2.internal.18d3b1e87da636f1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-66.ec2.internal,UID:ip-10-0-135-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-66.ec2.internal,},FirstTimestamp:2026-09-09 15:51:29.094792945 +0000 UTC m=+0.355922113,LastTimestamp:2026-09-09 15:51:29.094792945 +0000 UTC m=+0.355922113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-66.ec2.internal,}"
Sep 09 15:51:29.102589 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.102510    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wn6rf"
Sep 09 15:51:29.106135 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.106118    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 15:51:29.106677 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.106658    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 15:51:29.106868 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.106847    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.107219 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107203    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 15:51:29.107219 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107203    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 15:51:29.107325 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107228    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 15:51:29.107325 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107325    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 15:51:29.107430 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107332    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 15:51:29.107504 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107490    2578 factory.go:55] Registering systemd factory
Sep 09 15:51:29.107537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107508    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 09 15:51:29.107699 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107686    2578 factory.go:153] Registering CRI-O factory
Sep 09 15:51:29.107699 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107697    2578 factory.go:223] Registration of the crio container factory successfully
Sep 09 15:51:29.107816 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107738    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 15:51:29.107923 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107757    2578 factory.go:103] Registering Raw factory
Sep 09 15:51:29.107970 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.107934    2578 manager.go:1196] Started watching for new ooms in manager
Sep 09 15:51:29.108234 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.108224    2578 manager.go:349] Starting recovery of all containers
Sep 09 15:51:29.112518 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.112498    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:51:29.115559 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.115270    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-66.ec2.internal\" not found" node="ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.117960 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.117300    2578 manager.go:354] Recovery completed
Sep 09 15:51:29.123217 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.123201    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.125720 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.125699    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.125900 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.125874    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.126010 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.125916    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.126879 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.126860    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 15:51:29.126879 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.126878    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 15:51:29.127008 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.126897    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.127008 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.126900    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 15:51:29.127847 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.127827    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.127941 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.127867    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.127941 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.127885    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.207248 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.207217    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.267384 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.267327    2578 policy_none.go:49] "None policy: Start"
Sep 09 15:51:29.267384 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.267366    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 15:51:29.267384 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.267379    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 15:51:29.268474 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.268461    2578 policy_none.go:47] "Start"
Sep 09 15:51:29.297010 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.296989    2578 manager.go:337] "Starting Device Plugin manager"
Sep 09 15:51:29.297164 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.297038    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 15:51:29.297164 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.297050    2578 server.go:87] "Starting device plugin registration server"
Sep 09 15:51:29.297490 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.297477    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 15:51:29.297538 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.297492    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 15:51:29.297617 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.297599    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 15:51:29.297709 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.297696    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 15:51:29.297775 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.297711    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 15:51:29.298244 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.298224    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 15:51:29.298324 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.298271    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.360018 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.359972    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 15:51:29.361233 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.361211    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 15:51:29.361294 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.361284    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 15:51:29.361334 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.361315    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 15:51:29.361393 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.361378    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 15:51:29.363703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.363680    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:51:29.397658 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.397627    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.398688 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.398668    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.398802 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.398704    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.398802 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.398720    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.398802 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.398744    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.406403 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.406386    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.406495 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.406411    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-66.ec2.internal\": node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.420749 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.420724    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.462125 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.462062    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"]
Sep 09 15:51:29.462215 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.462180    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.463182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.463167    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.463251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.463198    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.463251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.463211    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.464544 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.464531    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.464665 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.464641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.464756 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.464693    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.465275 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.465257    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.465389 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.465291    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.465389 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.465307    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.465389 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.465366    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.465535 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.465392    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.465535 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.465407    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.466707 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.466692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.466785 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.466721    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 15:51:29.467448 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.467432    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 15:51:29.467547 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.467463    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 15:51:29.467547 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.467477    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Sep 09 15:51:29.490217 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.490187    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-66.ec2.internal\" not found" node="ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.494814 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.494793    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-66.ec2.internal\" not found" node="ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.509766 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.509734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/91430b5bb44a10f38fd89646c1d4f49d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-66.ec2.internal\" (UID: \"91430b5bb44a10f38fd89646c1d4f49d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.509766 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.509765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6934844b743ed22aef9486c0d0e46879-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"6934844b743ed22aef9486c0d0e46879\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.509940 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.509783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6934844b743ed22aef9486c0d0e46879-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"6934844b743ed22aef9486c0d0e46879\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.520827 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.520783    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.610548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.610444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6934844b743ed22aef9486c0d0e46879-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"6934844b743ed22aef9486c0d0e46879\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.610548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.610483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/91430b5bb44a10f38fd89646c1d4f49d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-66.ec2.internal\" (UID: \"91430b5bb44a10f38fd89646c1d4f49d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.610548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.610498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6934844b743ed22aef9486c0d0e46879-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"6934844b743ed22aef9486c0d0e46879\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.610548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.610554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6934844b743ed22aef9486c0d0e46879-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"6934844b743ed22aef9486c0d0e46879\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.610796 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.610573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/91430b5bb44a10f38fd89646c1d4f49d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-66.ec2.internal\" (UID: \"91430b5bb44a10f38fd89646c1d4f49d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.610796 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.610577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6934844b743ed22aef9486c0d0e46879-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"6934844b743ed22aef9486c0d0e46879\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.621582 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.621554    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.722083 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.722059    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.793320 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.793283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.797650 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:29.797629    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:29.822193 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.822164    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:29.922751 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:29.922663    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:30.023203 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:30.023168    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:30.042360 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.042326    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 15:51:30.042515 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.042496    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 15:51:30.042577 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.042530    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 15:51:30.106765 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.106731    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 15:46:30 +0000 UTC" deadline="2028-06-24 08:02:49.691481278 +0000 UTC"
Sep 09 15:51:30.106765 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.106761    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15688h11m19.584724681s"
Sep 09 15:51:30.124076 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:30.124054    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:30.224642 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:30.224571    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:30.325233 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:30.325190    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:30.425644 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:30.425609    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Sep 09 15:51:30.476794 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.476704    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:51:30.507697 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.507669    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:30.515511 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:30.515479    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6934844b743ed22aef9486c0d0e46879.slice/crio-af872ced6510a4eb991c00f6c6370a235b739b867ddb38c040208e96aa8e6892 WatchSource:0}: Error finding container af872ced6510a4eb991c00f6c6370a235b739b867ddb38c040208e96aa8e6892: Status 404 returned error can't find the container with id af872ced6510a4eb991c00f6c6370a235b739b867ddb38c040208e96aa8e6892
Sep 09 15:51:30.518894 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.518873    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 15:51:30.520802 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.520776    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Sep 09 15:51:30.520886 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.520819    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:51:30.528996 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.528972    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 15:51:30.567279 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:30.567249    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:51:31.085475 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.085431    2578 apiserver.go:52] "Watching apiserver"
Sep 09 15:51:31.092733 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.092709    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 15:51:31.093079 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.093054    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-tr7n8","openshift-ovn-kubernetes/ovnkube-node-5lsq7","kube-system/konnectivity-agent-clqfs","openshift-cluster-node-tuning-operator/tuned-dr4kf","openshift-dns/node-resolver-ngqh9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal","openshift-multus/network-metrics-daemon-9l5kb","openshift-network-operator/iptables-alerter-cq2th","kube-system/global-pull-secret-syncer-jh87r","kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg","openshift-image-registry/node-ca-vtphj","openshift-multus/multus-6bfn7","openshift-multus/multus-additional-cni-plugins-wbq48"]
Sep 09 15:51:31.095283 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.095267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.095366 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.095334    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:31.096407 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.096392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.097679 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.097659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.098520 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.098502    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xlh9x\""
Sep 09 15:51:31.098835 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.098805    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.098835 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.098811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 15:51:31.098975 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.098868    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.098975 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.098870    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 15:51:31.099237 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.099221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.099808 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.099792    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 15:51:31.099896 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.099880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dnnjn\""
Sep 09 15:51:31.099980 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.099966    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 15:51:31.100362 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.100331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.101245 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.101228    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.101333 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.101233    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rs6q7\""
Sep 09 15:51:31.101404 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.101387    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.101650 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.101634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.102307 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.102293    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.102701 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.102668    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.102749 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.102699    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssmlc\""
Sep 09 15:51:31.102966 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.102946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.103113 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.103017    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:31.103543 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.103526    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 15:51:31.103630 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.103563    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 15:51:31.103959 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.103943    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6hdm9\""
Sep 09 15:51:31.104263 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.104246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:31.104342 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.104324    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:31.105522 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.105505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.106795 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.106779    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 15:51:31.106795 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.106788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.108424 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.108318    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 15:51:31.108758 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.108736    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 15:51:31.108962 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.108934    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9pdd7\""
Sep 09 15:51:31.109826 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.109805    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.109993 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.109953    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.110125 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110111    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.110258 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 15:51:31.110416 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110394    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.110498 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2qjpd\""
Sep 09 15:51:31.110558 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110492    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 15:51:31.110650 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110634    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 15:51:31.110804 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.110787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.111621 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.111603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.113320 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.113268    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 15:51:31.113759 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.113737    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.113851 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.113742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dsnwk\""
Sep 09 15:51:31.113851 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.113745    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.113950 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.113855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 15:51:31.114021 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.114009    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 15:51:31.114055 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.114046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2swg\""
Sep 09 15:51:31.114672 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.114657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 15:51:31.117980 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.117962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-k8s-cni-cncf-io\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118063 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.117987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-conf-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118063 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-log-socket\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118063 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-cnibin\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118063 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysctl-conf\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/772acdbb-e881-40f6-a089-39847b812c67-kubelet-config\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqk8v\" (UniqueName: \"kubernetes.io/projected/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-kube-api-access-hqk8v\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d98ce2b-aeb8-4918-bcd2-0a64418b2327-agent-certs\") pod \"konnectivity-agent-clqfs\" (UID: \"1d98ce2b-aeb8-4918-bcd2-0a64418b2327\") " pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-kubernetes\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-run\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5zr\" (UniqueName: \"kubernetes.io/projected/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-kube-api-access-hq5zr\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-systemd\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118213 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-etc-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-cni-netd\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/754d6c4d-250a-4767-8ee4-b798b06136cd-cni-binary-copy\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-socket-dir-parent\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-cni-multus\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqtg\" (UniqueName: \"kubernetes.io/projected/754d6c4d-250a-4767-8ee4-b798b06136cd-kube-api-access-8fqtg\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4kdg\" (UniqueName: \"kubernetes.io/projected/39615f21-f5f0-4e98-8183-9e9d129497df-kube-api-access-g4kdg\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.118537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-system-cni-dir\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-kubelet\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-multus-certs\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d98ce2b-aeb8-4918-bcd2-0a64418b2327-konnectivity-ca\") pod \"konnectivity-agent-clqfs\" (UID: \"1d98ce2b-aeb8-4918-bcd2-0a64418b2327\") " pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-lib-modules\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aef2f60-c07a-48f5-851b-41c7b7f27347-host-slash\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-env-overrides\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-device-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39615f21-f5f0-4e98-8183-9e9d129497df-etc-tuned\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-cni-bin\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cfh\" (UniqueName: \"kubernetes.io/projected/c4c7ef73-5324-4b39-885b-aa24eeeee504-kube-api-access-r9cfh\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.118867 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-cni-bin\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-modprobe-d\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd551af-92b3-49f6-88f8-0c44a905315a-tmp-dir\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovnkube-script-lib\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.118995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/772acdbb-e881-40f6-a089-39847b812c67-dbus\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-systemd-units\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-cni-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-host\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-cnibin\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-ovn\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-node-log\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysconfig\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39615f21-f5f0-4e98-8183-9e9d129497df-tmp\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffd551af-92b3-49f6-88f8-0c44a905315a-hosts-file\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.119568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119381    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysctl-d\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-slash\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-var-lib-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-run-ovn-kubernetes\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-kubelet\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-netns\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-systemd\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jwjl\" (UniqueName: \"kubernetes.io/projected/2aef2f60-c07a-48f5-851b-41c7b7f27347-kube-api-access-8jwjl\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w976\" (UniqueName: \"kubernetes.io/projected/ffd551af-92b3-49f6-88f8-0c44a905315a-kube-api-access-9w976\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4bww\" (UniqueName: \"kubernetes.io/projected/dcc07e59-b7a3-4108-976e-9491c3635849-kube-api-access-w4bww\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-socket-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-system-cni-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-daemon-config\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.120174 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-etc-kubernetes\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-var-lib-kubelet\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovnkube-config\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovn-node-metrics-cert\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-registration-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-hostroot\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-run-netns\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.119974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-sys-fs\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.120002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-sys\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.120038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.120064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2aef2f60-c07a-48f5-851b-41c7b7f27347-iptables-alerter-script\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.120681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.120081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.136893 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.136872    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4hwp"
Sep 09 15:51:31.144259 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.144234    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4hwp"
Sep 09 15:51:31.208548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.208515    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 15:51:31.220852 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.220817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-modprobe-d\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.220852 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.220855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd551af-92b3-49f6-88f8-0c44a905315a-tmp-dir\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.221091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.220878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovnkube-script-lib\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.221091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.220932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/772acdbb-e881-40f6-a089-39847b812c67-dbus\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.221091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.220962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.221091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.220989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-systemd-units\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.221091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-modprobe-d\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.221091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-systemd-units\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/772acdbb-e881-40f6-a089-39847b812c67-dbus\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-cni-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-host\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-cnibin\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-ovn\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-node-log\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd551af-92b3-49f6-88f8-0c44a905315a-tmp-dir\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysconfig\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39615f21-f5f0-4e98-8183-9e9d129497df-tmp\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffd551af-92b3-49f6-88f8-0c44a905315a-hosts-file\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.221410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-ovn\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-serviceca\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysctl-d\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-cni-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-slash\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-var-lib-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-host\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-run-ovn-kubernetes\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-node-log\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-cnibin\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysconfig\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-run-ovn-kubernetes\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovnkube-script-lib\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-kubelet\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222012 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-slash\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221675    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-kubelet\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-host\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-netns\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffd551af-92b3-49f6-88f8-0c44a905315a-hosts-file\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-systemd\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-var-lib-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jwjl\" (UniqueName: \"kubernetes.io/projected/2aef2f60-c07a-48f5-851b-41c7b7f27347-kube-api-access-8jwjl\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w976\" (UniqueName: \"kubernetes.io/projected/ffd551af-92b3-49f6-88f8-0c44a905315a-kube-api-access-9w976\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysctl-d\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-netns\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.221938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-systemd\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4bww\" (UniqueName: \"kubernetes.io/projected/dcc07e59-b7a3-4108-976e-9491c3635849-kube-api-access-w4bww\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222299    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-socket-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.222801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-system-cni-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-daemon-config\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-etc-kubernetes\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-var-lib-kubelet\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovnkube-config\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-socket-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-etc-kubernetes\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-var-lib-kubelet\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-system-cni-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovn-node-metrics-cert\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-registration-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-registration-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-hostroot\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.222982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-daemon-config\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.223620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-run-netns\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovnkube-config\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-run-netns\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-hostroot\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-sys-fs\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfhn4\" (UniqueName: \"kubernetes.io/projected/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-kube-api-access-cfhn4\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-sys\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-sys-fs\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2aef2f60-c07a-48f5-851b-41c7b7f27347-iptables-alerter-script\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcc07e59-b7a3-4108-976e-9491c3635849-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-k8s-cni-cncf-io\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-k8s-cni-cncf-io\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-conf-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.223923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-conf-dir\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.224071    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:31.224327 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.224175    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:31.724133711 +0000 UTC m=+2.985262884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-log-socket\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-cnibin\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-log-socket\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2aef2f60-c07a-48f5-851b-41c7b7f27347-iptables-alerter-script\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-cnibin\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysctl-conf\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/772acdbb-e881-40f6-a089-39847b812c67-kubelet-config\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-sysctl-conf\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqk8v\" (UniqueName: \"kubernetes.io/projected/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-kube-api-access-hqk8v\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d98ce2b-aeb8-4918-bcd2-0a64418b2327-agent-certs\") pod \"konnectivity-agent-clqfs\" (UID: \"1d98ce2b-aeb8-4918-bcd2-0a64418b2327\") " pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/772acdbb-e881-40f6-a089-39847b812c67-kubelet-config\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-kubernetes\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-run\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-etc-kubernetes\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5zr\" (UniqueName: \"kubernetes.io/projected/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-kube-api-access-hq5zr\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.225203 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-systemd\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-etc-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-cni-netd\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/754d6c4d-250a-4767-8ee4-b798b06136cd-cni-binary-copy\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-socket-dir-parent\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-cni-multus\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.224971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqtg\" (UniqueName: \"kubernetes.io/projected/754d6c4d-250a-4767-8ee4-b798b06136cd-kube-api-access-8fqtg\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4kdg\" (UniqueName: \"kubernetes.io/projected/39615f21-f5f0-4e98-8183-9e9d129497df-kube-api-access-g4kdg\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-system-cni-dir\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcc07e59-b7a3-4108-976e-9491c3635849-system-cni-dir\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-kubelet\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-cni-netd\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-multus-certs\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d98ce2b-aeb8-4918-bcd2-0a64418b2327-konnectivity-ca\") pod \"konnectivity-agent-clqfs\" (UID: \"1d98ce2b-aeb8-4918-bcd2-0a64418b2327\") " pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-lib-modules\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.225964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aef2f60-c07a-48f5-851b-41c7b7f27347-host-slash\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-env-overrides\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-device-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39615f21-f5f0-4e98-8183-9e9d129497df-etc-tuned\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-cni-bin\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cfh\" (UniqueName: \"kubernetes.io/projected/c4c7ef73-5324-4b39-885b-aa24eeeee504-kube-api-access-r9cfh\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-cni-bin\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-cni-bin\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-run\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/754d6c4d-250a-4767-8ee4-b798b06136cd-cni-binary-copy\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-multus-socket-dir-parent\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.225814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-cni-multus\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-run-systemd\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-etc-openvswitch\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-var-lib-kubelet\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.226738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/754d6c4d-250a-4767-8ee4-b798b06136cd-host-run-multus-certs\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d98ce2b-aeb8-4918-bcd2-0a64418b2327-konnectivity-ca\") pod \"konnectivity-agent-clqfs\" (UID: \"1d98ce2b-aeb8-4918-bcd2-0a64418b2327\") " pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.226757    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-device-dir\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.226837    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:51:31.726818764 +0000 UTC m=+2.987947922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4c7ef73-5324-4b39-885b-aa24eeeee504-host-cni-bin\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39615f21-f5f0-4e98-8183-9e9d129497df-tmp\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.226965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aef2f60-c07a-48f5-851b-41c7b7f27347-host-slash\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.227128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-lib-modules\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.227208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4c7ef73-5324-4b39-885b-aa24eeeee504-ovn-node-metrics-cert\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.227471 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.227287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4c7ef73-5324-4b39-885b-aa24eeeee504-env-overrides\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.228491 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.228444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39615f21-f5f0-4e98-8183-9e9d129497df-sys\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.230004 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.229819    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:51:31.230004 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.229841    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:51:31.230004 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.229855    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:31.230004 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.229924    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:31.7299062 +0000 UTC m=+2.991035354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:31.230004 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.229941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d98ce2b-aeb8-4918-bcd2-0a64418b2327-agent-certs\") pod \"konnectivity-agent-clqfs\" (UID: \"1d98ce2b-aeb8-4918-bcd2-0a64418b2327\") " pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.230328 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.230072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39615f21-f5f0-4e98-8183-9e9d129497df-etc-tuned\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.232592 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.232401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4bww\" (UniqueName: \"kubernetes.io/projected/dcc07e59-b7a3-4108-976e-9491c3635849-kube-api-access-w4bww\") pod \"multus-additional-cni-plugins-wbq48\" (UID: \"dcc07e59-b7a3-4108-976e-9491c3635849\") " pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.232592 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.232476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w976\" (UniqueName: \"kubernetes.io/projected/ffd551af-92b3-49f6-88f8-0c44a905315a-kube-api-access-9w976\") pod \"node-resolver-ngqh9\" (UID: \"ffd551af-92b3-49f6-88f8-0c44a905315a\") " pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.232873 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.232847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jwjl\" (UniqueName: \"kubernetes.io/projected/2aef2f60-c07a-48f5-851b-41c7b7f27347-kube-api-access-8jwjl\") pod \"iptables-alerter-cq2th\" (UID: \"2aef2f60-c07a-48f5-851b-41c7b7f27347\") " pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.233484 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.233458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5zr\" (UniqueName: \"kubernetes.io/projected/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-kube-api-access-hq5zr\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.233820 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.233801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqk8v\" (UniqueName: \"kubernetes.io/projected/fd1991ec-26d6-4006-b0e5-5bb9f642bdaf-kube-api-access-hqk8v\") pod \"aws-ebs-csi-driver-node-2n8tg\" (UID: \"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.234671 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.234647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqtg\" (UniqueName: \"kubernetes.io/projected/754d6c4d-250a-4767-8ee4-b798b06136cd-kube-api-access-8fqtg\") pod \"multus-6bfn7\" (UID: \"754d6c4d-250a-4767-8ee4-b798b06136cd\") " pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.235057 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.235038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4kdg\" (UniqueName: \"kubernetes.io/projected/39615f21-f5f0-4e98-8183-9e9d129497df-kube-api-access-g4kdg\") pod \"tuned-dr4kf\" (UID: \"39615f21-f5f0-4e98-8183-9e9d129497df\") " pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.235673 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.235654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cfh\" (UniqueName: \"kubernetes.io/projected/c4c7ef73-5324-4b39-885b-aa24eeeee504-kube-api-access-r9cfh\") pod \"ovnkube-node-5lsq7\" (UID: \"c4c7ef73-5324-4b39-885b-aa24eeeee504\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.283596 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.283561    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:51:31.325380 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.325332    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 15:51:31.326531 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.326509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-serviceca\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.326608 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.326539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-host\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.326608 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.326573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfhn4\" (UniqueName: \"kubernetes.io/projected/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-kube-api-access-cfhn4\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.326681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.326625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-host\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.326954 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.326937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-serviceca\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.333871 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.333845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfhn4\" (UniqueName: \"kubernetes.io/projected/842b9ceb-3fe2-4598-9103-e4ea19c2bacb-kube-api-access-cfhn4\") pod \"node-ca-vtphj\" (UID: \"842b9ceb-3fe2-4598-9103-e4ea19c2bacb\") " pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.365481 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.365377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" event={"ID":"6934844b743ed22aef9486c0d0e46879","Type":"ContainerStarted","Data":"af872ced6510a4eb991c00f6c6370a235b739b867ddb38c040208e96aa8e6892"}
Sep 09 15:51:31.406767 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.406720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bfn7"
Sep 09 15:51:31.417254 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.417057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:31.417478 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.417450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754d6c4d_250a_4767_8ee4_b798b06136cd.slice/crio-05282702bcac6b29467e74623c1d6359a44754dfedf6c6b31cae500256f13e92 WatchSource:0}: Error finding container 05282702bcac6b29467e74623c1d6359a44754dfedf6c6b31cae500256f13e92: Status 404 returned error can't find the container with id 05282702bcac6b29467e74623c1d6359a44754dfedf6c6b31cae500256f13e92
Sep 09 15:51:31.423278 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.423248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dr4kf"
Sep 09 15:51:31.426843 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.426819    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d98ce2b_aeb8_4918_bcd2_0a64418b2327.slice/crio-f27c17412424ac22fda5e90386b17c4a1df41759c74acaab9e701c589a391f34 WatchSource:0}: Error finding container f27c17412424ac22fda5e90386b17c4a1df41759c74acaab9e701c589a391f34: Status 404 returned error can't find the container with id f27c17412424ac22fda5e90386b17c4a1df41759c74acaab9e701c589a391f34
Sep 09 15:51:31.427752 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.427730    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ngqh9"
Sep 09 15:51:31.433703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.433677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbq48"
Sep 09 15:51:31.433970 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.433943    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39615f21_f5f0_4e98_8183_9e9d129497df.slice/crio-78c8c17f797ede785bbe519c5a0208def5b7f12341b4c8573c16be9ab1cb00b6 WatchSource:0}: Error finding container 78c8c17f797ede785bbe519c5a0208def5b7f12341b4c8573c16be9ab1cb00b6: Status 404 returned error can't find the container with id 78c8c17f797ede785bbe519c5a0208def5b7f12341b4c8573c16be9ab1cb00b6
Sep 09 15:51:31.438391 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.438330    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd551af_92b3_49f6_88f8_0c44a905315a.slice/crio-2a1a4cc05eb019c527ee62137703849291e134dfba260b9062701fab6628a0e5 WatchSource:0}: Error finding container 2a1a4cc05eb019c527ee62137703849291e134dfba260b9062701fab6628a0e5: Status 404 returned error can't find the container with id 2a1a4cc05eb019c527ee62137703849291e134dfba260b9062701fab6628a0e5
Sep 09 15:51:31.439625 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.439600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:31.446364 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.446327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cq2th"
Sep 09 15:51:31.446693 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.446669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc07e59_b7a3_4108_976e_9491c3635849.slice/crio-88a7c5b7f613d6388e95bb3addc1f2a34791fd2537088cdcf061eeac7ab24dcf WatchSource:0}: Error finding container 88a7c5b7f613d6388e95bb3addc1f2a34791fd2537088cdcf061eeac7ab24dcf: Status 404 returned error can't find the container with id 88a7c5b7f613d6388e95bb3addc1f2a34791fd2537088cdcf061eeac7ab24dcf
Sep 09 15:51:31.449987 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.449959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c7ef73_5324_4b39_885b_aa24eeeee504.slice/crio-8b26794b206da6519be27702aa4794ceb7c89bd235df84184578b8f3e2b0f59a WatchSource:0}: Error finding container 8b26794b206da6519be27702aa4794ceb7c89bd235df84184578b8f3e2b0f59a: Status 404 returned error can't find the container with id 8b26794b206da6519be27702aa4794ceb7c89bd235df84184578b8f3e2b0f59a
Sep 09 15:51:31.451947 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.451924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg"
Sep 09 15:51:31.455931 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.455904    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aef2f60_c07a_48f5_851b_41c7b7f27347.slice/crio-7c7471dad1539d384ea6fba0242bdee317f47eeb334ce37237d449f5731864f0 WatchSource:0}: Error finding container 7c7471dad1539d384ea6fba0242bdee317f47eeb334ce37237d449f5731864f0: Status 404 returned error can't find the container with id 7c7471dad1539d384ea6fba0242bdee317f47eeb334ce37237d449f5731864f0
Sep 09 15:51:31.456931 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.456747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vtphj"
Sep 09 15:51:31.461460 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.461433    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1991ec_26d6_4006_b0e5_5bb9f642bdaf.slice/crio-9e62d516dd8eec23d6e4adb42b89ab8eab5d0bf8e36a0fcabb6b61b0fb867ffd WatchSource:0}: Error finding container 9e62d516dd8eec23d6e4adb42b89ab8eab5d0bf8e36a0fcabb6b61b0fb867ffd: Status 404 returned error can't find the container with id 9e62d516dd8eec23d6e4adb42b89ab8eab5d0bf8e36a0fcabb6b61b0fb867ffd
Sep 09 15:51:31.468848 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:51:31.468822    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842b9ceb_3fe2_4598_9103_e4ea19c2bacb.slice/crio-e57499facbed658780d66a125670b6c5a13564032824bf409a9658bb491df214 WatchSource:0}: Error finding container e57499facbed658780d66a125670b6c5a13564032824bf409a9658bb491df214: Status 404 returned error can't find the container with id e57499facbed658780d66a125670b6c5a13564032824bf409a9658bb491df214
Sep 09 15:51:31.729872 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.729778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:31.729872 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.729830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:31.730101 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.729962    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:31.730101 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.729967    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:31.730101 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.730035    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:51:32.730016172 +0000 UTC m=+3.991145329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:31.730101 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.730054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:32.730045408 +0000 UTC m=+3.991174571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:31.830874 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:31.830833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:31.831085 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.831016    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:51:31.831085 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.831039    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:51:31.831085 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.831051    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:31.831813 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:31.831381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:32.831356389 +0000 UTC m=+4.092485544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:32.145998 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.145913    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 15:46:32 +0000 UTC" deadline="2028-04-29 06:22:11.512025247 +0000 UTC"
Sep 09 15:51:32.145998 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.145984    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14342h30m39.366046225s"
Sep 09 15:51:32.361658 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.361565    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:32.361844 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.361710    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:32.376620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.374109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"8b26794b206da6519be27702aa4794ceb7c89bd235df84184578b8f3e2b0f59a"}
Sep 09 15:51:32.376620 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.376558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerStarted","Data":"88a7c5b7f613d6388e95bb3addc1f2a34791fd2537088cdcf061eeac7ab24dcf"}
Sep 09 15:51:32.378539 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.378466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-clqfs" event={"ID":"1d98ce2b-aeb8-4918-bcd2-0a64418b2327","Type":"ContainerStarted","Data":"f27c17412424ac22fda5e90386b17c4a1df41759c74acaab9e701c589a391f34"}
Sep 09 15:51:32.380188 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.380142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vtphj" event={"ID":"842b9ceb-3fe2-4598-9103-e4ea19c2bacb","Type":"ContainerStarted","Data":"e57499facbed658780d66a125670b6c5a13564032824bf409a9658bb491df214"}
Sep 09 15:51:32.383124 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.383096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg" event={"ID":"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf","Type":"ContainerStarted","Data":"9e62d516dd8eec23d6e4adb42b89ab8eab5d0bf8e36a0fcabb6b61b0fb867ffd"}
Sep 09 15:51:32.386272 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.386239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cq2th" event={"ID":"2aef2f60-c07a-48f5-851b-41c7b7f27347","Type":"ContainerStarted","Data":"7c7471dad1539d384ea6fba0242bdee317f47eeb334ce37237d449f5731864f0"}
Sep 09 15:51:32.388199 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.388106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ngqh9" event={"ID":"ffd551af-92b3-49f6-88f8-0c44a905315a","Type":"ContainerStarted","Data":"2a1a4cc05eb019c527ee62137703849291e134dfba260b9062701fab6628a0e5"}
Sep 09 15:51:32.392073 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.392043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dr4kf" event={"ID":"39615f21-f5f0-4e98-8183-9e9d129497df","Type":"ContainerStarted","Data":"78c8c17f797ede785bbe519c5a0208def5b7f12341b4c8573c16be9ab1cb00b6"}
Sep 09 15:51:32.394219 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.394171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bfn7" event={"ID":"754d6c4d-250a-4767-8ee4-b798b06136cd","Type":"ContainerStarted","Data":"05282702bcac6b29467e74623c1d6359a44754dfedf6c6b31cae500256f13e92"}
Sep 09 15:51:32.740225 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.740116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:32.740225 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.740201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:32.740482 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.740342    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:32.740482 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.740425    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:51:34.740404143 +0000 UTC m=+6.001533316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:32.740911 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.740888    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:32.741048 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.740950    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:34.740933917 +0000 UTC m=+6.002063073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:32.841449 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:32.841405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:32.841665 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.841613    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:51:32.841665 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.841637    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:51:32.841665 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.841651    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:32.841828 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:32.841716    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:34.841697267 +0000 UTC m=+6.102826429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:33.147255 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:33.147151    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 15:46:32 +0000 UTC" deadline="2028-03-05 07:01:29.441909279 +0000 UTC"
Sep 09 15:51:33.147255 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:33.147193    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13023h9m56.294720745s"
Sep 09 15:51:33.364762 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:33.364698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:33.364950 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:33.364849    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:33.364950 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:33.364919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:33.365152 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:33.365066    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:33.403131 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:33.402518    2578 generic.go:356] "Generic (PLEG): container finished" podID="6934844b743ed22aef9486c0d0e46879" containerID="18a0832800a2abfba8dfe38eb3664db9b143a2bb68cedee3f8c4f19c7ba8aeac" exitCode=0
Sep 09 15:51:33.403131 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:33.402574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" event={"ID":"6934844b743ed22aef9486c0d0e46879","Type":"ContainerDied","Data":"18a0832800a2abfba8dfe38eb3664db9b143a2bb68cedee3f8c4f19c7ba8aeac"}
Sep 09 15:51:34.363465 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:34.363411    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:34.364070 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.363581    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:34.760155 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:34.760030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:34.760392 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:34.760363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:34.774213 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.773637    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:34.774213 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.773748    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:51:38.773720162 +0000 UTC m=+10.034849320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:34.775779 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.774502    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:34.775779 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.774578    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:38.774558929 +0000 UTC m=+10.035688087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:34.862523 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:34.861771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:34.862523 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.862018    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:51:34.862523 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.862044    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:51:34.862523 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.862057    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:34.862523 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:34.862123    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:38.862103168 +0000 UTC m=+10.123232340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:35.362564 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:35.362529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:35.362762 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:35.362578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:35.362762 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:35.362679    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:35.362901 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:35.362796    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:36.362601 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:36.362571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:36.363096 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:36.362721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:37.362257 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:37.362223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:37.362462 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:37.362376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:37.362462 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:37.362398    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:37.362592 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:37.362480    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:38.362434 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:38.362378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:38.362916 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.362533    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:38.803300 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:38.803222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:38.803505 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:38.803320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:38.803505 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.803402    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:38.803505 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.803459    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:38.803505 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.803489    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:51:46.803467628 +0000 UTC m=+18.064596802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:38.803755 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.803518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:46.803500439 +0000 UTC m=+18.064629599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:38.903675 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:38.903627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:38.903843 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.903822    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:51:38.903907 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.903852    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:51:38.903907 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.903872    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:38.904003 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:38.903930    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:51:46.903913586 +0000 UTC m=+18.165042741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:39.363921 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:39.363204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:39.363921 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:39.363330    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:39.363921 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:39.363783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:39.363921 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:39.363877    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:40.361652 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:40.361551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:40.361828 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:40.361710    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:41.364973 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:41.364933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:41.365718 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:41.365100    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:41.365718 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:41.365195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:41.365718 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:41.365280    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:42.362491 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:42.362452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:42.362679 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:42.362593    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:43.362168 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:43.362129    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:43.362721 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:43.362274    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:43.362721 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:43.362321    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:43.362721 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:43.362454    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:44.362497 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:44.362461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:44.362930 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:44.362574    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:45.361631 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:45.361602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:45.361824 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:45.361717    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:45.361824 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:45.361796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:45.361935 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:45.361890    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:46.362522 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:46.362492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:46.362990 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.362632    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:46.867440 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:46.867409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:46.867674 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:46.867463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:46.867674 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.867573    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:46.867674 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.867644    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:52:02.867623748 +0000 UTC m=+34.128752915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:51:46.867674 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.867575    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:46.867894 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.867732    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:02.867710967 +0000 UTC m=+34.128840121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:51:46.968041 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:46.967995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:46.968219 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.968167    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:51:46.968219 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.968186    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:51:46.968219 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.968196    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:46.968408 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:46.968255    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:02.968241903 +0000 UTC m=+34.229371061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:51:47.362395 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:47.362299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:47.362395 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:47.362362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:47.362871 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:47.362445    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:47.362871 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:47.362565    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:48.362004 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:48.361975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:48.362167 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:48.362087    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:49.362646 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:49.362613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:49.363055 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:49.362724    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:49.363055 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:49.362753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:49.363055 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:49.362818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:50.361939 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.361653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:50.362074 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:50.362055    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:50.437324 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.437290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal" event={"ID":"91430b5bb44a10f38fd89646c1d4f49d","Type":"ContainerStarted","Data":"fa0c25179a5ea2a760aef9cc2783a28577bec82a3272304739b9299fb5e6c996"}
Sep 09 15:51:50.439402 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.439326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vtphj" event={"ID":"842b9ceb-3fe2-4598-9103-e4ea19c2bacb","Type":"ContainerStarted","Data":"01c2bd7b9fe82a8d1cab5cddbc998ccdef601d2a7a3f2be08b703d0bf3db0702"}
Sep 09 15:51:50.441687 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.441662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg" event={"ID":"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf","Type":"ContainerStarted","Data":"8498631713a37a5387302e76ef64ce9c62554d5a14230897b1ba45016b7d5b70"}
Sep 09 15:51:50.443501 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.443389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ngqh9" event={"ID":"ffd551af-92b3-49f6-88f8-0c44a905315a","Type":"ContainerStarted","Data":"64ca2f08e4687320d3f8188cfeb3d898e5bbb2f384ef67fc84d52af8769d5f03"}
Sep 09 15:51:50.445650 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.445606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dr4kf" event={"ID":"39615f21-f5f0-4e98-8183-9e9d129497df","Type":"ContainerStarted","Data":"54c8689393981260c825ea53a2c38bf1505856cc443e1ed666c36ad9b3186197"}
Sep 09 15:51:50.448751 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.448728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bfn7" event={"ID":"754d6c4d-250a-4767-8ee4-b798b06136cd","Type":"ContainerStarted","Data":"df687146ad9fa62fec56cd74bf738754ec3b0130f0a62755510373dbc52a16fe"}
Sep 09 15:51:50.451891 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.451867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" event={"ID":"6934844b743ed22aef9486c0d0e46879","Type":"ContainerStarted","Data":"2fe6ec29bd1f9eb09dcf9f294872d81936d02bb5450e18ad8c82d6c4446b2e0c"}
Sep 09 15:51:50.457011 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.456950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"324479371d2a32a6b1b4daa09814b4926e86838e2ca47f209d0e5e4fd244a456"}
Sep 09 15:51:50.457105 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.457014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"cf5f8eedf811c431daf6ddba12a731c564e91b51858dd184e713bfe1844d3758"}
Sep 09 15:51:50.457105 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.457066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"0521bb14d652f50110d917f1003932281a0db924c423a35acedd84cc56cb0bd8"}
Sep 09 15:51:50.457228 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.457112    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"de2db8f17ff91ca22ea5d88a3e7ca0baa6229908efbc40030bc6071e720162bb"}
Sep 09 15:51:50.459117 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.459089    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcc07e59-b7a3-4108-976e-9491c3635849" containerID="0b56ffa82088ac82dc76d02bff6414d33519f99e255fb3ecef489e7bb7a5a810" exitCode=0
Sep 09 15:51:50.459221 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.459118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerDied","Data":"0b56ffa82088ac82dc76d02bff6414d33519f99e255fb3ecef489e7bb7a5a810"}
Sep 09 15:51:50.461451 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.461428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-clqfs" event={"ID":"1d98ce2b-aeb8-4918-bcd2-0a64418b2327","Type":"ContainerStarted","Data":"e831f16de876e885fde579af3a3bfb3170d744ab80bbfb1af4989083ecb71c49"}
Sep 09 15:51:50.472773 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.471753    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vtphj" podStartSLOduration=5.595360499 podStartE2EDuration="20.471717751s" totalImagesPullingTime="14.876357252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:50.454457095 +0000 UTC m=+21.715586283" watchObservedRunningTime="2026-09-09 15:51:50.471717751 +0000 UTC m=+21.732847008"
Sep 09 15:51:50.490314 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.490276    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ngqh9" podStartSLOduration=1.971236122 podStartE2EDuration="20.490262003s" totalImagesPullingTime="18.519025881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:50.472767648 +0000 UTC m=+21.733896824" watchObservedRunningTime="2026-09-09 15:51:50.490262003 +0000 UTC m=+21.751391225"
Sep 09 15:51:50.490428 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.490366    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" podStartSLOduration=19.490361313 podStartE2EDuration="19.490361313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:50.489905631 +0000 UTC m=+21.751034808" watchObservedRunningTime="2026-09-09 15:51:50.490361313 +0000 UTC m=+21.751490482"
Sep 09 15:51:50.508233 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.508189    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6bfn7" podStartSLOduration=1.751197927 podStartE2EDuration="20.50817705s" totalImagesPullingTime="18.756979123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:50.507971181 +0000 UTC m=+21.769100358" watchObservedRunningTime="2026-09-09 15:51:50.50817705 +0000 UTC m=+21.769306226"
Sep 09 15:51:50.523903 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.523645    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dr4kf" podStartSLOduration=1.997909353 podStartE2EDuration="20.523632173s" totalImagesPullingTime="18.52572282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:50.523033198 +0000 UTC m=+21.784162374" watchObservedRunningTime="2026-09-09 15:51:50.523632173 +0000 UTC m=+21.784761349"
Sep 09 15:51:50.558944 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:50.558445    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-clqfs" podStartSLOduration=5.641090262 podStartE2EDuration="20.558433163s" totalImagesPullingTime="14.917342901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:50.537468867 +0000 UTC m=+21.798598044" watchObservedRunningTime="2026-09-09 15:51:50.558433163 +0000 UTC m=+21.819562338"
Sep 09 15:51:51.362583 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:51.362546    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:51.362745 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:51.362669    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:51.362745 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:51.362725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:51.362857 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:51.362830    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:51.467299 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:51.467268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"6e4816198997f8e7bed5cfcfc96cca336377920572628d1c048c4e1bc3ede67d"}
Sep 09 15:51:51.467908 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:51.467363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"73dc566b2022a3bbbb20ffe303c383504bca2d885e0b19d315ea13ff73076989"}
Sep 09 15:51:51.468903 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:51.468872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cq2th" event={"ID":"2aef2f60-c07a-48f5-851b-41c7b7f27347","Type":"ContainerStarted","Data":"991062b9e6fb20f3424ae20863f3552aebeae3dbf59e4024ad76f41be165854f"}
Sep 09 15:51:51.483361 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:51.483304    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cq2th" podStartSLOduration=2.977800503 podStartE2EDuration="21.48328863s" totalImagesPullingTime="18.505488127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:51.483189449 +0000 UTC m=+22.744318619" watchObservedRunningTime="2026-09-09 15:51:51.48328863 +0000 UTC m=+22.744417807"
Sep 09 15:51:52.316955 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:52.316926    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 15:51:52.362416 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:52.362336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:52.362503 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:52.362468    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:52.473368 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:52.473317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal" event={"ID":"91430b5bb44a10f38fd89646c1d4f49d","Type":"ContainerStarted","Data":"0d8236761de3a948f69f2d74de2eb8a77f3b1f8ec0b44d792da888590942d453"}
Sep 09 15:51:52.475328 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:52.475305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg" event={"ID":"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf","Type":"ContainerStarted","Data":"94940d229f5481ecd3d3bca3e5c089b4d214984cb38576b99e1566dec6d07c73"}
Sep 09 15:51:52.486127 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:52.486089    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal" podStartSLOduration=21.486076455 podStartE2EDuration="21.486076455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:52.485957167 +0000 UTC m=+23.747086344" watchObservedRunningTime="2026-09-09 15:51:52.486076455 +0000 UTC m=+23.747205632"
Sep 09 15:51:53.311547 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.311262    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T15:51:52.316949708Z","UUID":"6ac3a270-7afc-45c8-88f6-246050373153","Handler":null,"Name":"","Endpoint":""}
Sep 09 15:51:53.313076 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.312851    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 15:51:53.313076 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.312888    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 15:51:53.362371 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.362085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:53.362371 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:53.362216    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:53.362371 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.362247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:53.362613 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:53.362376    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:53.481282 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.481170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"82e8306f57eb850478719333babe47e15dad24f0293a3333053de25ff992e200"}
Sep 09 15:51:53.483580 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.483552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg" event={"ID":"fd1991ec-26d6-4006-b0e5-5bb9f642bdaf","Type":"ContainerStarted","Data":"7ad908e369329f330f0bc1736ce7ce7b3799b5148ac028447cd0ea43a7344428"}
Sep 09 15:51:53.499581 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:53.499533    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n8tg" podStartSLOduration=2.213688115 podStartE2EDuration="23.499519634s" totalImagesPullingTime="21.285831519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:53.499517256 +0000 UTC m=+24.760646431" watchObservedRunningTime="2026-09-09 15:51:53.499519634 +0000 UTC m=+24.760648810"
Sep 09 15:51:54.362180 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:54.362142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:54.362412 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:54.362287    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:54.518928 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:54.518896    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:54.519485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:54.519467    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:51:55.361586 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.361556    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:55.361750 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.361599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:55.361750 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:55.361682    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:55.361866 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:55.361789    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:55.492866 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.492836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" event={"ID":"c4c7ef73-5324-4b39-885b-aa24eeeee504","Type":"ContainerStarted","Data":"9e8672b15630228a3cf9f047d37cf1c9d99a2f61c9d2eca5df92f6ccffa2c67c"}
Sep 09 15:51:55.493031 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.493013    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:55.493100 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.493068    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:55.493159 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.493120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:55.510011 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.509787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:55.510427 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.510064    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:51:55.524900 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:55.523835    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7" podStartSLOduration=6.997915224 podStartE2EDuration="25.523769581s" totalImagesPullingTime="18.525854357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:51:55.518541932 +0000 UTC m=+26.779671108" watchObservedRunningTime="2026-09-09 15:51:55.523769581 +0000 UTC m=+26.784898760"
Sep 09 15:51:56.362254 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:56.362076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:56.362422 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:56.362329    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:56.496578 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:56.496540    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcc07e59-b7a3-4108-976e-9491c3635849" containerID="0f9f52531269d6f7bef870854bd5084944c0707631c3ad7dd67d713c2abe6e69" exitCode=0
Sep 09 15:51:56.496723 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:56.496625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerDied","Data":"0f9f52531269d6f7bef870854bd5084944c0707631c3ad7dd67d713c2abe6e69"}
Sep 09 15:51:57.362052 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.362026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:57.362661 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:57.362156    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:57.362661 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.362217    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:57.362661 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:57.362326    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:57.513787 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.513763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jh87r"]
Sep 09 15:51:57.513889 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.513854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:57.513966 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:57.513945    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:57.516854 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.516787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tr7n8"]
Sep 09 15:51:57.516992 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.516881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:57.517069 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:57.516969    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:57.517650 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.517634    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9l5kb"]
Sep 09 15:51:57.517754 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:57.517713    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:57.517852 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:57.517807    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:58.503597 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:58.503565    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcc07e59-b7a3-4108-976e-9491c3635849" containerID="acd71757c7e959614b8698070c1d3db561e4eb1b6b1f8f7450ff6dbf5a2445b9" exitCode=0
Sep 09 15:51:58.504117 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:58.503608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerDied","Data":"acd71757c7e959614b8698070c1d3db561e4eb1b6b1f8f7450ff6dbf5a2445b9"}
Sep 09 15:51:59.363296 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:59.363054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:51:59.363431 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:59.363082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:51:59.363431 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:59.363111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:51:59.363721 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:59.363692    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:51:59.363825 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:59.363802    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:51:59.363907 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:51:59.363889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:51:59.508457 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:59.508312    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcc07e59-b7a3-4108-976e-9491c3635849" containerID="b1aea7f6d7d43006783223c6b6338ceec63e7ceb21da0bc6507f10df6550ef9b" exitCode=0
Sep 09 15:51:59.508457 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:51:59.508376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerDied","Data":"b1aea7f6d7d43006783223c6b6338ceec63e7ceb21da0bc6507f10df6550ef9b"}
Sep 09 15:52:00.987821 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:00.987785    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:52:00.988197 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:00.987987    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 15:52:00.988517 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:00.988491    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-clqfs"
Sep 09 15:52:01.362520 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:01.362435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:01.362688 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:01.362435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:52:01.362688 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:01.362559    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tr7n8" podUID="bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8"
Sep 09 15:52:01.362688 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:01.362569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:52:01.362688 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:01.362633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh87r" podUID="772acdbb-e881-40f6-a089-39847b812c67"
Sep 09 15:52:01.362875 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:01.362730    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:52:02.881681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:02.881651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:52:02.882091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:02.881745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:52:02.882091 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.881827    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:52:02.882091 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.881862    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 15:52:02.882091 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.881907    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:52:34.881885485 +0000 UTC m=+66.143014653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 15:52:02.882091 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.881928    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret podName:772acdbb-e881-40f6-a089-39847b812c67 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:34.881918073 +0000 UTC m=+66.143047231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret") pod "global-pull-secret-syncer-jh87r" (UID: "772acdbb-e881-40f6-a089-39847b812c67") : object "kube-system"/"original-pull-secret" not registered
Sep 09 15:52:02.982855 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:02.982733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:02.983368 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.982926    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 15:52:02.983368 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.982953    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 15:52:02.983368 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.982967    2578 projected.go:196] Error preparing data for projected volume kube-api-access-f528d for pod openshift-network-diagnostics/network-check-target-tr7n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:52:02.983368 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:02.983029    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d podName:bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:34.983012692 +0000 UTC m=+66.244141865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f528d" (UniqueName: "kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d") pod "network-check-target-tr7n8" (UID: "bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 15:52:03.040905 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.040869    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeReady"
Sep 09 15:52:03.041092 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.041034    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 15:52:03.080362 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.080328    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gbctk"]
Sep 09 15:52:03.092457 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.092431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c6gfk"]
Sep 09 15:52:03.092617 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.092585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.095652 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.095626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 15:52:03.095808 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.095679    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xfw9\""
Sep 09 15:52:03.095808 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.095692    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 15:52:03.102666 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.102645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbctk"]
Sep 09 15:52:03.102775 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.102677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6gfk"]
Sep 09 15:52:03.102836 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.102770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.105142 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.105122    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 15:52:03.105142 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.105133    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 15:52:03.105301 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.105157    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 15:52:03.105344 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.105331    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7tqp\""
Sep 09 15:52:03.184100 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.184053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42257bc1-4d2a-4d3e-884b-fecce892dffa-cert\") pod \"ingress-canary-c6gfk\" (UID: \"42257bc1-4d2a-4d3e-884b-fecce892dffa\") " pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.184100 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.184096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25g28\" (UniqueName: \"kubernetes.io/projected/42257bc1-4d2a-4d3e-884b-fecce892dffa-kube-api-access-25g28\") pod \"ingress-canary-c6gfk\" (UID: \"42257bc1-4d2a-4d3e-884b-fecce892dffa\") " pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.184418 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.184127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71a5085d-b887-48ae-9152-d715e6d61760-config-volume\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.184418 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.184214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.184418 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.184264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2zb\" (UniqueName: \"kubernetes.io/projected/71a5085d-b887-48ae-9152-d715e6d61760-kube-api-access-vl2zb\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.184418 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.184308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a5085d-b887-48ae-9152-d715e6d61760-tmp-dir\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.285161 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2zb\" (UniqueName: \"kubernetes.io/projected/71a5085d-b887-48ae-9152-d715e6d61760-kube-api-access-vl2zb\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.285161 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a5085d-b887-48ae-9152-d715e6d61760-tmp-dir\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.285408 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42257bc1-4d2a-4d3e-884b-fecce892dffa-cert\") pod \"ingress-canary-c6gfk\" (UID: \"42257bc1-4d2a-4d3e-884b-fecce892dffa\") " pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.285408 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25g28\" (UniqueName: \"kubernetes.io/projected/42257bc1-4d2a-4d3e-884b-fecce892dffa-kube-api-access-25g28\") pod \"ingress-canary-c6gfk\" (UID: \"42257bc1-4d2a-4d3e-884b-fecce892dffa\") " pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.285408 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71a5085d-b887-48ae-9152-d715e6d61760-config-volume\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.285408 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.285408 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:03.285389    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:03.285645 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:03.285451    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:03.785432367 +0000 UTC m=+35.046561527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:03.285730 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.285706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a5085d-b887-48ae-9152-d715e6d61760-tmp-dir\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.286224 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.286198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71a5085d-b887-48ae-9152-d715e6d61760-config-volume\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.289919 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.289898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42257bc1-4d2a-4d3e-884b-fecce892dffa-cert\") pod \"ingress-canary-c6gfk\" (UID: \"42257bc1-4d2a-4d3e-884b-fecce892dffa\") " pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.295932 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.295879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25g28\" (UniqueName: \"kubernetes.io/projected/42257bc1-4d2a-4d3e-884b-fecce892dffa-kube-api-access-25g28\") pod \"ingress-canary-c6gfk\" (UID: \"42257bc1-4d2a-4d3e-884b-fecce892dffa\") " pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.296592 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.296575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2zb\" (UniqueName: \"kubernetes.io/projected/71a5085d-b887-48ae-9152-d715e6d61760-kube-api-access-vl2zb\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.361934 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.361897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:52:03.362156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.361897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:03.362156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.361897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:52:03.364815 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.364787    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 15:52:03.364815 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.364804    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 15:52:03.364815 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.364813    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 15:52:03.365105 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.364802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tvtml\""
Sep 09 15:52:03.365105 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.364946    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 15:52:03.365105 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.364901    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2dhs\""
Sep 09 15:52:03.410843 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.410821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6gfk"
Sep 09 15:52:03.713413 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.713329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6gfk"]
Sep 09 15:52:03.718674 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:52:03.718496    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42257bc1_4d2a_4d3e_884b_fecce892dffa.slice/crio-80e3c5401239f3bec71029d8dbeea4c2f68098b4132f0b6f3895525c160177b6 WatchSource:0}: Error finding container 80e3c5401239f3bec71029d8dbeea4c2f68098b4132f0b6f3895525c160177b6: Status 404 returned error can't find the container with id 80e3c5401239f3bec71029d8dbeea4c2f68098b4132f0b6f3895525c160177b6
Sep 09 15:52:03.789570 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:03.789536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:03.789773 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:03.789699    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:03.789817 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:03.789779    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:04.78976325 +0000 UTC m=+36.050892405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:04.521462 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:04.521427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6gfk" event={"ID":"42257bc1-4d2a-4d3e-884b-fecce892dffa","Type":"ContainerStarted","Data":"80e3c5401239f3bec71029d8dbeea4c2f68098b4132f0b6f3895525c160177b6"}
Sep 09 15:52:04.796114 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:04.796023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:04.796283 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:04.796207    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:04.796340 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:04.796296    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:06.7962735 +0000 UTC m=+38.057402678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:06.812497 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:06.812460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:06.812937 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:06.812630    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:06.812937 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:06.812695    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:10.812679145 +0000 UTC m=+42.073808299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:07.532303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:07.532229    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcc07e59-b7a3-4108-976e-9491c3635849" containerID="91a91098e74946784ddabe3bfd44241267b12a7c9cb19327ce54f872e8c414a9" exitCode=0
Sep 09 15:52:07.532303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:07.532284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerDied","Data":"91a91098e74946784ddabe3bfd44241267b12a7c9cb19327ce54f872e8c414a9"}
Sep 09 15:52:08.538936 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:08.538902    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcc07e59-b7a3-4108-976e-9491c3635849" containerID="228ac0476d08123a058b05b9733d09cc108e1d4d5b69589f526d834d7a6781b0" exitCode=0
Sep 09 15:52:08.539635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:08.538961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerDied","Data":"228ac0476d08123a058b05b9733d09cc108e1d4d5b69589f526d834d7a6781b0"}
Sep 09 15:52:09.545454 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:09.545418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbq48" event={"ID":"dcc07e59-b7a3-4108-976e-9491c3635849","Type":"ContainerStarted","Data":"fb49df37263431e6ec045d1b2d3135e7cd485daf6683d5d96b16e66cdac2132e"}
Sep 09 15:52:09.566440 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:09.566383    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wbq48" podStartSLOduration=6.792980055 podStartE2EDuration="39.566340662s" totalImagesPullingTime="32.773360607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:52:09.565916367 +0000 UTC m=+40.827045543" watchObservedRunningTime="2026-09-09 15:52:09.566340662 +0000 UTC m=+40.827469840"
Sep 09 15:52:10.549505 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:10.549466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6gfk" event={"ID":"42257bc1-4d2a-4d3e-884b-fecce892dffa","Type":"ContainerStarted","Data":"df6b4fee39bdf17d9dc1a31d26d78c1863e128cf4545901c6711c6ffdd1aa258"}
Sep 09 15:52:10.564583 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:10.564511    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c6gfk" podStartSLOduration=1.7937346459999999 podStartE2EDuration="7.564492605s" totalImagesPullingTime="5.770757959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:52:10.563884649 +0000 UTC m=+41.825013824" watchObservedRunningTime="2026-09-09 15:52:10.564492605 +0000 UTC m=+41.825621786"
Sep 09 15:52:10.843640 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:10.843547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:10.843797 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:10.843661    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:10.843797 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:10.843715    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:18.843701177 +0000 UTC m=+50.104830330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:18.897773 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:18.897731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:18.898133 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:18.897854    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:18.898133 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:18.897913    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:52:34.89789683 +0000 UTC m=+66.159026008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:27.517370 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:27.517328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lsq7"
Sep 09 15:52:34.903314 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:34.903267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:52:34.903314 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:34.903321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:52:34.903873 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:34.903363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:52:34.903873 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:34.903452    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:52:34.903873 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:34.903505    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:53:06.903491709 +0000 UTC m=+98.164620869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:52:34.906040 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:34.906022    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 15:52:34.906091 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:34.906066    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 15:52:34.913870 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:34.913842    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 15:52:34.913973 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:52:34.913913    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:53:38.913896669 +0000 UTC m=+130.175025826 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : secret "metrics-daemon-secret" not found
Sep 09 15:52:34.916792 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:34.916765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/772acdbb-e881-40f6-a089-39847b812c67-original-pull-secret\") pod \"global-pull-secret-syncer-jh87r\" (UID: \"772acdbb-e881-40f6-a089-39847b812c67\") " pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:52:35.004583 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.004533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:35.007206 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.007184    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 15:52:35.017833 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.017807    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 15:52:35.028200 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.028165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f528d\" (UniqueName: \"kubernetes.io/projected/bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8-kube-api-access-f528d\") pod \"network-check-target-tr7n8\" (UID: \"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8\") " pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:35.183148 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.183062    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tvtml\""
Sep 09 15:52:35.186103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.186083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh87r"
Sep 09 15:52:35.191128 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.191104    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:35.460225 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.460190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jh87r"]
Sep 09 15:52:35.463052 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.463025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tr7n8"]
Sep 09 15:52:35.463724 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:52:35.463699    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772acdbb_e881_40f6_a089_39847b812c67.slice/crio-b8116d6e69c7e2c321b7c7b65f0be48e52e466dd1663bef86f261af2d9192e52 WatchSource:0}: Error finding container b8116d6e69c7e2c321b7c7b65f0be48e52e466dd1663bef86f261af2d9192e52: Status 404 returned error can't find the container with id b8116d6e69c7e2c321b7c7b65f0be48e52e466dd1663bef86f261af2d9192e52
Sep 09 15:52:35.466308 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:52:35.466287    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9dd93a_f8c7_4520_ae55_99fdc6a6d0d8.slice/crio-cb28b4fb90cae071a27b42a2e67f98e1f9344efa17a12bc9cede8db501a6a183 WatchSource:0}: Error finding container cb28b4fb90cae071a27b42a2e67f98e1f9344efa17a12bc9cede8db501a6a183: Status 404 returned error can't find the container with id cb28b4fb90cae071a27b42a2e67f98e1f9344efa17a12bc9cede8db501a6a183
Sep 09 15:52:35.613011 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.612971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tr7n8" event={"ID":"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8","Type":"ContainerStarted","Data":"cb28b4fb90cae071a27b42a2e67f98e1f9344efa17a12bc9cede8db501a6a183"}
Sep 09 15:52:35.614067 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:35.614041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jh87r" event={"ID":"772acdbb-e881-40f6-a089-39847b812c67","Type":"ContainerStarted","Data":"b8116d6e69c7e2c321b7c7b65f0be48e52e466dd1663bef86f261af2d9192e52"}
Sep 09 15:52:38.778075 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.778035    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"]
Sep 09 15:52:38.797906 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.797743    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"]
Sep 09 15:52:38.797906 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.797880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.801038 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.800827    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 15:52:38.802251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.801869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 15:52:38.802251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.802097    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 15:52:38.802251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.802172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 15:52:38.833810 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.833773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d602b57b-c8ed-4303-bdd4-adb6c3447b87-klusterlet-config\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.833810 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.833814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rds2d\" (UniqueName: \"kubernetes.io/projected/d602b57b-c8ed-4303-bdd4-adb6c3447b87-kube-api-access-rds2d\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.834048 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.833865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d602b57b-c8ed-4303-bdd4-adb6c3447b87-tmp\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.934636 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.934589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d602b57b-c8ed-4303-bdd4-adb6c3447b87-tmp\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.934819 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.934736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d602b57b-c8ed-4303-bdd4-adb6c3447b87-klusterlet-config\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.934819 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.934781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rds2d\" (UniqueName: \"kubernetes.io/projected/d602b57b-c8ed-4303-bdd4-adb6c3447b87-kube-api-access-rds2d\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.935132 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.935027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d602b57b-c8ed-4303-bdd4-adb6c3447b87-tmp\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.937939 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.937913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d602b57b-c8ed-4303-bdd4-adb6c3447b87-klusterlet-config\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:38.943663 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:38.943633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rds2d\" (UniqueName: \"kubernetes.io/projected/d602b57b-c8ed-4303-bdd4-adb6c3447b87-kube-api-access-rds2d\") pod \"klusterlet-addon-workmgr-784df94767-q8fdr\" (UID: \"d602b57b-c8ed-4303-bdd4-adb6c3447b87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:39.111387 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:39.111291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:40.999492 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:40.999031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"]
Sep 09 15:52:41.002596 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:52:41.002568    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd602b57b_c8ed_4303_bdd4_adb6c3447b87.slice/crio-14403fd9fa540252bc5dbb2140f1a95098e0e74561f40fdcfca155c7e5b35064 WatchSource:0}: Error finding container 14403fd9fa540252bc5dbb2140f1a95098e0e74561f40fdcfca155c7e5b35064: Status 404 returned error can't find the container with id 14403fd9fa540252bc5dbb2140f1a95098e0e74561f40fdcfca155c7e5b35064
Sep 09 15:52:41.633410 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:41.633373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tr7n8" event={"ID":"bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8","Type":"ContainerStarted","Data":"121c13eede9764c114e66087a7c5e1f0b7f91df2f241c02e14dd700550d535f5"}
Sep 09 15:52:41.633637 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:41.633507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:52:41.634498 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:41.634476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr" event={"ID":"d602b57b-c8ed-4303-bdd4-adb6c3447b87","Type":"ContainerStarted","Data":"14403fd9fa540252bc5dbb2140f1a95098e0e74561f40fdcfca155c7e5b35064"}
Sep 09 15:52:41.635729 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:41.635704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jh87r" event={"ID":"772acdbb-e881-40f6-a089-39847b812c67","Type":"ContainerStarted","Data":"a8f545c0c5d75a388265b03202f6cf7c87dc2c54537a3ca489395d39614f453f"}
Sep 09 15:52:41.648538 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:41.648484    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tr7n8" podStartSLOduration=66.374882476 podStartE2EDuration="1m11.648469516s" totalImagesPullingTime="5.27358704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:52:41.648001246 +0000 UTC m=+72.909130422" watchObservedRunningTime="2026-09-09 15:52:41.648469516 +0000 UTC m=+72.909598729"
Sep 09 15:52:41.661271 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:41.661223    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jh87r" podStartSLOduration=66.389710722 podStartE2EDuration="1m11.661206065s" totalImagesPullingTime="5.271495343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:52:41.660806347 +0000 UTC m=+72.921935525" watchObservedRunningTime="2026-09-09 15:52:41.661206065 +0000 UTC m=+72.922335232"
Sep 09 15:52:45.648971 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:45.648933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr" event={"ID":"d602b57b-c8ed-4303-bdd4-adb6c3447b87","Type":"ContainerStarted","Data":"3d223fcf93bb9d04b7bdce935e2740dc717b72abf4e1f1fc02afba4921ace64e"}
Sep 09 15:52:45.649486 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:45.649248    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:45.650820 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:45.650797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:52:45.663753 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:52:45.663700    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr" podStartSLOduration=3.857859404 podStartE2EDuration="7.663683608s" totalImagesPullingTime="3.805824204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:52:45.663380037 +0000 UTC m=+76.924509205" watchObservedRunningTime="2026-09-09 15:52:45.663683608 +0000 UTC m=+76.924812780"
Sep 09 15:53:06.922957 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:53:06.922817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:53:06.923447 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:53:06.922969    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:53:06.923447 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:53:06.923044    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:54:10.923027328 +0000 UTC m=+162.184156485 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:53:12.641423 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:53:12.641391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tr7n8"
Sep 09 15:53:38.940385 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:53:38.940323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:53:38.940869 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:53:38.940479    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 15:53:38.940869 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:53:38.940550    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:55:40.940530682 +0000 UTC m=+252.201659836 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : secret "metrics-daemon-secret" not found
Sep 09 15:54:06.103500 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:54:06.103443    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbctk" podUID="71a5085d-b887-48ae-9152-d715e6d61760"
Sep 09 15:54:06.374095 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:54:06.373985    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:54:06.842440 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:06.842402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbctk"
Sep 09 15:54:10.968340 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:10.968293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:54:10.968881 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:54:10.968485    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 15:54:10.968881 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:54:10.968583    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls podName:71a5085d-b887-48ae-9152-d715e6d61760 nodeName:}" failed. No retries permitted until 2026-09-09 15:56:12.968558822 +0000 UTC m=+284.229687976 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls") pod "dns-default-gbctk" (UID: "71a5085d-b887-48ae-9152-d715e6d61760") : secret "dns-default-metrics-tls" not found
Sep 09 15:54:18.361657 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:18.361621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:54:44.933838 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:44.933806    2578 generic.go:356] "Generic (PLEG): container finished" podID="d602b57b-c8ed-4303-bdd4-adb6c3447b87" containerID="3d223fcf93bb9d04b7bdce935e2740dc717b72abf4e1f1fc02afba4921ace64e" exitCode=1
Sep 09 15:54:44.934245 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:44.933891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr" event={"ID":"d602b57b-c8ed-4303-bdd4-adb6c3447b87","Type":"ContainerDied","Data":"3d223fcf93bb9d04b7bdce935e2740dc717b72abf4e1f1fc02afba4921ace64e"}
Sep 09 15:54:44.934245 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:44.934226    2578 scope.go:117] "RemoveContainer" containerID="3d223fcf93bb9d04b7bdce935e2740dc717b72abf4e1f1fc02afba4921ace64e"
Sep 09 15:54:45.649541 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:45.649495    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:54:45.938199 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:45.938117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr" event={"ID":"d602b57b-c8ed-4303-bdd4-adb6c3447b87","Type":"ContainerStarted","Data":"58952cae33d4de652e3fa00075b508241372c36784a840ec77f3aaf4615736fc"}
Sep 09 15:54:45.938635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:45.938377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:54:45.938957 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:54:45.938938    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784df94767-q8fdr"
Sep 09 15:55:38.683479 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.683445    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-25ztf"]
Sep 09 15:55:38.685336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.685319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.688430 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.688409    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-775cbbfd5d-w7f9r"]
Sep 09 15:55:38.688548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.688494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 15:55:38.688611 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.688582    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 15:55:38.689876 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.689858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 15:55:38.689988 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.689858    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 15:55:38.689988 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.689861    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xq255\""
Sep 09 15:55:38.690452 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.690434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.693803 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.693753    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 15:55:38.694576 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.694528    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 15:55:38.694726 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.694710    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 15:55:38.694726 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.694733    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 15:55:38.694726 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.694713    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 15:55:38.694977 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.694918    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 15:55:38.694977 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.694954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 15:55:38.695613 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.695597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cr8p9\""
Sep 09 15:55:38.702456 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.702430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-25ztf"]
Sep 09 15:55:38.708542 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.708512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-775cbbfd5d-w7f9r"]
Sep 09 15:55:38.763799 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.763761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k546b\" (UniqueName: \"kubernetes.io/projected/7dd47e64-abdc-4819-a238-8548a75af6b7-kube-api-access-k546b\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.763799 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.763800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-default-certificate\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.763799 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.763816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.764066 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.763833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd47e64-abdc-4819-a238-8548a75af6b7-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.764066 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.763849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd47e64-abdc-4819-a238-8548a75af6b7-serving-cert\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.764066 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.763920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dd47e64-abdc-4819-a238-8548a75af6b7-tmp\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.764066 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.764002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.764066 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.764031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-stats-auth\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.764066 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.764060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxsr\" (UniqueName: \"kubernetes.io/projected/a3c9e417-88aa-49fc-afaf-8c0988eaf278-kube-api-access-kkxsr\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.764268 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.764092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dd47e64-abdc-4819-a238-8548a75af6b7-snapshots\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.764268 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.764128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd47e64-abdc-4819-a238-8548a75af6b7-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.778364 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.778326    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"]
Sep 09 15:55:38.780318 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.780302    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df7bd8756-bn88q"]
Sep 09 15:55:38.780448 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.780428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.782156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.782137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.783289 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.783262    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 15:55:38.783601 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.783586    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 15:55:38.783652 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.783604    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 15:55:38.783693 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.783664    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rx884\""
Sep 09 15:55:38.783763 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.783730    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 15:55:38.784692 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.784677    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 15:55:38.785180 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.785166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 15:55:38.785691 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.785671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 15:55:38.785789 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.785743    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwhjq\""
Sep 09 15:55:38.790964 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.790944    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 15:55:38.793459 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.793431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"]
Sep 09 15:55:38.794849 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.794830    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df7bd8756-bn88q"]
Sep 09 15:55:38.865504 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-image-registry-private-configuration\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.865504 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-certificates\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-trusted-ca\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k546b\" (UniqueName: \"kubernetes.io/projected/7dd47e64-abdc-4819-a238-8548a75af6b7-kube-api-access-k546b\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbzpc\" (UniqueName: \"kubernetes.io/projected/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-kube-api-access-gbzpc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd47e64-abdc-4819-a238-8548a75af6b7-serving-cert\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.865744 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dd47e64-abdc-4819-a238-8548a75af6b7-tmp\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-bound-sa-token\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-stats-auth\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:38.865951    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:39.36592979 +0000 UTC m=+250.627058959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : configmap references non-existent config key: service-ca.crt
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxsr\" (UniqueName: \"kubernetes.io/projected/a3c9e417-88aa-49fc-afaf-8c0988eaf278-kube-api-access-kkxsr\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.865997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dd47e64-abdc-4819-a238-8548a75af6b7-snapshots\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klgdb\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-kube-api-access-klgdb\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dd47e64-abdc-4819-a238-8548a75af6b7-tmp\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-installation-pull-secrets\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd47e64-abdc-4819-a238-8548a75af6b7-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-default-certificate\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.866182 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd47e64-abdc-4819-a238-8548a75af6b7-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.866903 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07b4ffb8-d586-4168-bba1-75baabbb65f3-ca-trust-extracted\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.866903 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:38.866231    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:55:38.866903 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:38.866281    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:39.366265652 +0000 UTC m=+250.627394809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : secret "router-metrics-certs-default" not found
Sep 09 15:55:38.866903 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dd47e64-abdc-4819-a238-8548a75af6b7-snapshots\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.866903 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd47e64-abdc-4819-a238-8548a75af6b7-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.867168 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.866965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd47e64-abdc-4819-a238-8548a75af6b7-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.868273 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.868252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd47e64-abdc-4819-a238-8548a75af6b7-serving-cert\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.868458 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.868428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-stats-auth\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.868513 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.868456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-default-certificate\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.874462 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.874441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxsr\" (UniqueName: \"kubernetes.io/projected/a3c9e417-88aa-49fc-afaf-8c0988eaf278-kube-api-access-kkxsr\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:38.875186 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.875168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k546b\" (UniqueName: \"kubernetes.io/projected/7dd47e64-abdc-4819-a238-8548a75af6b7-kube-api-access-k546b\") pod \"insights-operator-76bcd6ccf5-25ztf\" (UID: \"7dd47e64-abdc-4819-a238-8548a75af6b7\") " pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:38.967284 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbzpc\" (UniqueName: \"kubernetes.io/projected/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-kube-api-access-gbzpc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.967485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.967485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-bound-sa-token\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klgdb\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-kube-api-access-klgdb\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-installation-pull-secrets\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07b4ffb8-d586-4168-bba1-75baabbb65f3-ca-trust-extracted\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967485 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-image-registry-private-configuration\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-certificates\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.967587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-trusted-ca\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:38.967635    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:38.967657    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7bd8756-bn88q: secret "image-registry-tls" not found
Sep 09 15:55:38.967765 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:38.967725    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls podName:07b4ffb8-d586-4168-bba1-75baabbb65f3 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:39.467705872 +0000 UTC m=+250.728835034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls") pod "image-registry-df7bd8756-bn88q" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3") : secret "image-registry-tls" not found
Sep 09 15:55:38.968178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.968050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07b4ffb8-d586-4168-bba1-75baabbb65f3-ca-trust-extracted\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.968292 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.968267    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-certificates\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.968539 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.968517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.968539 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.968531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-trusted-ca\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.969923 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.969905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-image-registry-private-configuration\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.970282 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.970189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.970282 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.970265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-installation-pull-secrets\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.975155 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.975111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbzpc\" (UniqueName: \"kubernetes.io/projected/9e3d132d-dc7f-42ee-ae8c-88eab997c87b-kube-api-access-gbzpc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8cmnz\" (UID: \"9e3d132d-dc7f-42ee-ae8c-88eab997c87b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:38.975271 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.975245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-bound-sa-token\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.975545 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.975523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klgdb\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-kube-api-access-klgdb\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:38.996251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:38.996217    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf"
Sep 09 15:55:39.089848 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:39.089817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"
Sep 09 15:55:39.261973 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:39.261867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-25ztf"]
Sep 09 15:55:39.264405 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:55:39.264378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd47e64_abdc_4819_a238_8548a75af6b7.slice/crio-dfd69f50ce8f78dd91b500a44dee3dc3d6c12131c4ef2a1e90b3d748a76e78e4 WatchSource:0}: Error finding container dfd69f50ce8f78dd91b500a44dee3dc3d6c12131c4ef2a1e90b3d748a76e78e4: Status 404 returned error can't find the container with id dfd69f50ce8f78dd91b500a44dee3dc3d6c12131c4ef2a1e90b3d748a76e78e4
Sep 09 15:55:39.353304 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:39.353278    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz"]
Sep 09 15:55:39.355851 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:55:39.355828    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3d132d_dc7f_42ee_ae8c_88eab997c87b.slice/crio-c42d9cb2e56323d10d1bb5983cb8a7176342e35b88f29801d47d6747748983ca WatchSource:0}: Error finding container c42d9cb2e56323d10d1bb5983cb8a7176342e35b88f29801d47d6747748983ca: Status 404 returned error can't find the container with id c42d9cb2e56323d10d1bb5983cb8a7176342e35b88f29801d47d6747748983ca
Sep 09 15:55:39.372079 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:39.372058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:39.372167 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:39.372132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:39.372206 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:39.372189    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:55:39.372237 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:39.372226    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:40.372214295 +0000 UTC m=+251.633343452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : configmap references non-existent config key: service-ca.crt
Sep 09 15:55:39.372276 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:39.372241    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:40.372233835 +0000 UTC m=+251.633362989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : secret "router-metrics-certs-default" not found
Sep 09 15:55:39.472884 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:39.472841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:39.473055 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:39.472999    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:55:39.473055 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:39.473017    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7bd8756-bn88q: secret "image-registry-tls" not found
Sep 09 15:55:39.473137 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:39.473072    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls podName:07b4ffb8-d586-4168-bba1-75baabbb65f3 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:40.473055676 +0000 UTC m=+251.734184832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls") pod "image-registry-df7bd8756-bn88q" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3") : secret "image-registry-tls" not found
Sep 09 15:55:40.071099 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:40.071063    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf" event={"ID":"7dd47e64-abdc-4819-a238-8548a75af6b7","Type":"ContainerStarted","Data":"dfd69f50ce8f78dd91b500a44dee3dc3d6c12131c4ef2a1e90b3d748a76e78e4"}
Sep 09 15:55:40.072366 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:40.072330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz" event={"ID":"9e3d132d-dc7f-42ee-ae8c-88eab997c87b","Type":"ContainerStarted","Data":"c42d9cb2e56323d10d1bb5983cb8a7176342e35b88f29801d47d6747748983ca"}
Sep 09 15:55:40.379924 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:40.379835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:40.380079 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:40.379953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:40.380079 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.380030    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:55:40.380182 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.380097    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:42.380078668 +0000 UTC m=+253.641207823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : configmap references non-existent config key: service-ca.crt
Sep 09 15:55:40.380182 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.380117    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:42.380109502 +0000 UTC m=+253.641238658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : secret "router-metrics-certs-default" not found
Sep 09 15:55:40.480895 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:40.480846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:40.481078 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.481023    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:55:40.481078 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.481046    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7bd8756-bn88q: secret "image-registry-tls" not found
Sep 09 15:55:40.481194 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.481114    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls podName:07b4ffb8-d586-4168-bba1-75baabbb65f3 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:42.481089712 +0000 UTC m=+253.742218868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls") pod "image-registry-df7bd8756-bn88q" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3") : secret "image-registry-tls" not found
Sep 09 15:55:40.984730 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:40.984692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:55:40.984932 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.984867    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 15:55:40.985002 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:40.984944    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs podName:7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b nodeName:}" failed. No retries permitted until 2026-09-09 15:57:42.984923351 +0000 UTC m=+374.246052507 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs") pod "network-metrics-daemon-9l5kb" (UID: "7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b") : secret "metrics-daemon-secret" not found
Sep 09 15:55:42.080976 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.080934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf" event={"ID":"7dd47e64-abdc-4819-a238-8548a75af6b7","Type":"ContainerStarted","Data":"7c84c5a62a03d22ccb04f810b594d2a8fb9901b9a2c6b853e4e83f344e313200"}
Sep 09 15:55:42.082439 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.082408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz" event={"ID":"9e3d132d-dc7f-42ee-ae8c-88eab997c87b","Type":"ContainerStarted","Data":"4c78a1db5a5fc05184c138dfc06aa28ab914418c4c8b1d43973741a9afaa1fe8"}
Sep 09 15:55:42.098327 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.098280    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf" podStartSLOduration=1.402964754 podStartE2EDuration="4.098263352s" totalImagesPullingTime="2.695298598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:55:42.097655983 +0000 UTC m=+253.358785158" watchObservedRunningTime="2026-09-09 15:55:42.098263352 +0000 UTC m=+253.359392531"
Sep 09 15:55:42.112419 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.112379    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz" podStartSLOduration=1.508915312 podStartE2EDuration="4.112368896s" totalImagesPullingTime="2.603453584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:55:42.111467836 +0000 UTC m=+253.372597029" watchObservedRunningTime="2026-09-09 15:55:42.112368896 +0000 UTC m=+253.373498066"
Sep 09 15:55:42.396122 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.396022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:42.396122 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.396105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:42.396340 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:42.396182    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:55:42.396340 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:42.396211    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:46.396198834 +0000 UTC m=+257.657327989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : configmap references non-existent config key: service-ca.crt
Sep 09 15:55:42.396340 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:42.396242    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:46.396225528 +0000 UTC m=+257.657354689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : secret "router-metrics-certs-default" not found
Sep 09 15:55:42.497001 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:42.496965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:42.497201 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:42.497101    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:55:42.497201 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:42.497119    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7bd8756-bn88q: secret "image-registry-tls" not found
Sep 09 15:55:42.497201 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:42.497182    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls podName:07b4ffb8-d586-4168-bba1-75baabbb65f3 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:46.497163711 +0000 UTC m=+257.758292867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls") pod "image-registry-df7bd8756-bn88q" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3") : secret "image-registry-tls" not found
Sep 09 15:55:43.187157 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.187123    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-64pkg"]
Sep 09 15:55:43.189232 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.189214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.191777 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.191757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 15:55:43.191876 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.191785    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 15:55:43.191876 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.191825    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqq2h\""
Sep 09 15:55:43.201085 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.201061    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-64pkg"]
Sep 09 15:55:43.304218 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.304175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgk2m\" (UniqueName: \"kubernetes.io/projected/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-api-access-hgk2m\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.304396 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.304278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.304396 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.304340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.304495 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.304398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-crio-socket\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.304495 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.304433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-data-volume\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405209 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgk2m\" (UniqueName: \"kubernetes.io/projected/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-api-access-hgk2m\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405400 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405400 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405400 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-crio-socket\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405400 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-data-volume\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405400 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.405336    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:43.405563 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.405417    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:55:43.405563 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.405429    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:43.905409445 +0000 UTC m=+255.166538600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:43.405563 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-crio-socket\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.405563 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.405467    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:43.90545323 +0000 UTC m=+255.166582384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : configmap "kube-rbac-proxy" not found
Sep 09 15:55:43.405704 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.405646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-data-volume\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.413078 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.413048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgk2m\" (UniqueName: \"kubernetes.io/projected/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-api-access-hgk2m\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.909700 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.909662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.909948 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:43.909757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:43.909948 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.909793    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:55:43.909948 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.909854    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:43.909948 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.909865    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:44.909847899 +0000 UTC m=+256.170977073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : configmap "kube-rbac-proxy" not found
Sep 09 15:55:43.909948 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:43.909893    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:44.909882327 +0000 UTC m=+256.171011485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:44.917945 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:44.917909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:44.918414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:44.918004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:44.918414 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:44.918044    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:55:44.918414 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:44.918112    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:46.918096087 +0000 UTC m=+258.179225245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : configmap "kube-rbac-proxy" not found
Sep 09 15:55:44.918414 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:44.918135    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:44.918414 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:44.918202    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:46.918184479 +0000 UTC m=+258.179313658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:45.941792 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:45.941762    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ngqh9_ffd551af-92b3-49f6-88f8-0c44a905315a/dns-node-resolver/0.log"
Sep 09 15:55:46.432677 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:46.432619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:46.432864 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:46.432736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:46.432864 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.432765    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 15:55:46.432864 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.432825    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:54.432811348 +0000 UTC m=+265.693940508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : secret "router-metrics-certs-default" not found
Sep 09 15:55:46.432864 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.432838    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:54.432832621 +0000 UTC m=+265.693961775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : configmap references non-existent config key: service-ca.crt
Sep 09 15:55:46.533943 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:46.533904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:46.534142 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.534096    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 15:55:46.534142 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.534120    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7bd8756-bn88q: secret "image-registry-tls" not found
Sep 09 15:55:46.534258 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.534188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls podName:07b4ffb8-d586-4168-bba1-75baabbb65f3 nodeName:}" failed. No retries permitted until 2026-09-09 15:55:54.534167752 +0000 UTC m=+265.795296911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls") pod "image-registry-df7bd8756-bn88q" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3") : secret "image-registry-tls" not found
Sep 09 15:55:46.937046 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:46.937009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:46.937214 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:46.937102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:46.937214 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.937137    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:55:46.937214 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.937201    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:50.937185452 +0000 UTC m=+262.198314610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : configmap "kube-rbac-proxy" not found
Sep 09 15:55:46.937214 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.937210    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:46.937368 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:46.937248    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:50.937236403 +0000 UTC m=+262.198365558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:46.941990 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:46.941958    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vtphj_842b9ceb-3fe2-4598-9103-e4ea19c2bacb/node-ca/0.log"
Sep 09 15:55:47.742916 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:47.742879    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6gfk_42257bc1-4d2a-4d3e-884b-fecce892dffa/serve-healthcheck-canary/0.log"
Sep 09 15:55:48.543761 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:48.543698    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8cmnz_9e3d132d-dc7f-42ee-ae8c-88eab997c87b/kube-storage-version-migrator-operator/0.log"
Sep 09 15:55:50.969673 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:50.969622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:50.970126 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:50.969687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:50.970126 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:50.969776    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 15:55:50.970126 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:50.969802    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:50.970126 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:50.969826    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:58.969813815 +0000 UTC m=+270.230942968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : configmap "kube-rbac-proxy" not found
Sep 09 15:55:50.970126 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:50.969886    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:55:58.969865685 +0000 UTC m=+270.230994841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:54.498987 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.498952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:54.499401 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.499075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:54.499401 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:54.499213    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle podName:a3c9e417-88aa-49fc-afaf-8c0988eaf278 nodeName:}" failed. No retries permitted until 2026-09-09 15:56:10.499191534 +0000 UTC m=+281.760320703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle") pod "router-default-775cbbfd5d-w7f9r" (UID: "a3c9e417-88aa-49fc-afaf-8c0988eaf278") : configmap references non-existent config key: service-ca.crt
Sep 09 15:55:54.501388 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.501367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3c9e417-88aa-49fc-afaf-8c0988eaf278-metrics-certs\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:55:54.600237 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.600199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:54.602634 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.602612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"image-registry-df7bd8756-bn88q\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") " pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:54.696904 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.696856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:54.970109 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:54.970067    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df7bd8756-bn88q"]
Sep 09 15:55:54.973163 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:55:54.973132    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b4ffb8_d586_4168_bba1_75baabbb65f3.slice/crio-5f2306e73c1bed1b595df4184e23c79b02c5e5a8f74e7461f773e286a702f38d WatchSource:0}: Error finding container 5f2306e73c1bed1b595df4184e23c79b02c5e5a8f74e7461f773e286a702f38d: Status 404 returned error can't find the container with id 5f2306e73c1bed1b595df4184e23c79b02c5e5a8f74e7461f773e286a702f38d
Sep 09 15:55:55.125489 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:55.125453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" event={"ID":"07b4ffb8-d586-4168-bba1-75baabbb65f3","Type":"ContainerStarted","Data":"a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8"}
Sep 09 15:55:55.125647 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:55.125503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" event={"ID":"07b4ffb8-d586-4168-bba1-75baabbb65f3","Type":"ContainerStarted","Data":"5f2306e73c1bed1b595df4184e23c79b02c5e5a8f74e7461f773e286a702f38d"}
Sep 09 15:55:55.125647 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:55.125586    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:55:55.144486 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:55.144435    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" podStartSLOduration=17.14441745 podStartE2EDuration="17.14441745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:55:55.14378817 +0000 UTC m=+266.404917348" watchObservedRunningTime="2026-09-09 15:55:55.14441745 +0000 UTC m=+266.405546623"
Sep 09 15:55:59.036738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:59.036691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:59.037156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:59.036789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:55:59.037156 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:59.036889    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:59.037156 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:55:59.036941    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls podName:3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb nodeName:}" failed. No retries permitted until 2026-09-09 15:56:15.0369265 +0000 UTC m=+286.298055659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-64pkg" (UID: "3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb") : secret "insights-runtime-extractor-tls" not found
Sep 09 15:55:59.037282 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:55:59.037255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:56:04.529947 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.529914    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df7bd8756-bn88q"]
Sep 09 15:56:04.569475 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.569440    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66867985d6-jq2lj"]
Sep 09 15:56:04.574647 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.574627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.585228 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.585203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66867985d6-jq2lj"]
Sep 09 15:56:04.679758 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-registry-certificates\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.679758 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-trusted-ca\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.679986 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-registry-tls\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.679986 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-image-registry-private-configuration\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.679986 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-ca-trust-extracted\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.679986 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-installation-pull-secrets\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.679986 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.679970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-bound-sa-token\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.680144 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.680006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82wv\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-kube-api-access-k82wv\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-registry-certificates\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-trusted-ca\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-registry-tls\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780743 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-image-registry-private-configuration\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780743 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-ca-trust-extracted\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780743 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-installation-pull-secrets\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780743 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-bound-sa-token\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.780743 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.780711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82wv\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-kube-api-access-k82wv\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.781499 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.781457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-registry-certificates\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.782158 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.781663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-ca-trust-extracted\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.787082 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.783733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-trusted-ca\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.787082 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.783961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-registry-tls\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.787082 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.784308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-image-registry-private-configuration\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.787082 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.785274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-installation-pull-secrets\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.791873 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.791852    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-bound-sa-token\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.793032 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.793013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82wv\" (UniqueName: \"kubernetes.io/projected/54fc8590-8a0a-4651-ba47-5b1cbcd25ae9-kube-api-access-k82wv\") pod \"image-registry-66867985d6-jq2lj\" (UID: \"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9\") " pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:04.883011 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:04.882973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:05.154689 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:05.154611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66867985d6-jq2lj"]
Sep 09 15:56:05.157569 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:05.157542    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fc8590_8a0a_4651_ba47_5b1cbcd25ae9.slice/crio-9691bb21b5eebc5d3970a4efa6a081cafefb6a498e3e8772ee6e060c8f5431cf WatchSource:0}: Error finding container 9691bb21b5eebc5d3970a4efa6a081cafefb6a498e3e8772ee6e060c8f5431cf: Status 404 returned error can't find the container with id 9691bb21b5eebc5d3970a4efa6a081cafefb6a498e3e8772ee6e060c8f5431cf
Sep 09 15:56:06.161173 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:06.161133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66867985d6-jq2lj" event={"ID":"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9","Type":"ContainerStarted","Data":"4e9b4627a8504bfd29a6a54bd11f2eee9ab7c362d66efeee89566ac854360e7e"}
Sep 09 15:56:06.161589 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:06.161188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66867985d6-jq2lj" event={"ID":"54fc8590-8a0a-4651-ba47-5b1cbcd25ae9","Type":"ContainerStarted","Data":"9691bb21b5eebc5d3970a4efa6a081cafefb6a498e3e8772ee6e060c8f5431cf"}
Sep 09 15:56:06.161589 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:06.161262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:06.179298 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:06.179246    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66867985d6-jq2lj" podStartSLOduration=2.179230646 podStartE2EDuration="2.179230646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:06.179120853 +0000 UTC m=+277.440250031" watchObservedRunningTime="2026-09-09 15:56:06.179230646 +0000 UTC m=+277.440359825"
Sep 09 15:56:09.843540 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:09.843483    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbctk" podUID="71a5085d-b887-48ae-9152-d715e6d61760"
Sep 09 15:56:10.175338 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:10.175258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbctk"
Sep 09 15:56:10.530285 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:10.530234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:10.530835 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:10.530815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c9e417-88aa-49fc-afaf-8c0988eaf278-service-ca-bundle\") pod \"router-default-775cbbfd5d-w7f9r\" (UID: \"a3c9e417-88aa-49fc-afaf-8c0988eaf278\") " pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:10.801225 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:10.801114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:11.075425 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:11.073010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-775cbbfd5d-w7f9r"]
Sep 09 15:56:11.078478 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:11.078449    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c9e417_88aa_49fc_afaf_8c0988eaf278.slice/crio-f43bc036e307809f9edacfc07826053833cd7bb116d0b65a23395ad49ff57ddf WatchSource:0}: Error finding container f43bc036e307809f9edacfc07826053833cd7bb116d0b65a23395ad49ff57ddf: Status 404 returned error can't find the container with id f43bc036e307809f9edacfc07826053833cd7bb116d0b65a23395ad49ff57ddf
Sep 09 15:56:11.179656 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:11.179622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r" event={"ID":"a3c9e417-88aa-49fc-afaf-8c0988eaf278","Type":"ContainerStarted","Data":"9eb33aabde1ff007c0fd42232b9564e7f55804ad0295a3375ba620588dd469a6"}
Sep 09 15:56:11.179891 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:11.179672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r" event={"ID":"a3c9e417-88aa-49fc-afaf-8c0988eaf278","Type":"ContainerStarted","Data":"f43bc036e307809f9edacfc07826053833cd7bb116d0b65a23395ad49ff57ddf"}
Sep 09 15:56:11.198631 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:11.198571    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r" podStartSLOduration=33.198554835 podStartE2EDuration="33.198554835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:11.197339233 +0000 UTC m=+282.458468409" watchObservedRunningTime="2026-09-09 15:56:11.198554835 +0000 UTC m=+282.459684011"
Sep 09 15:56:11.802020 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:11.801978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:11.804501 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:11.804475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:12.182618 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:12.182537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:12.183860 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:12.183835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-775cbbfd5d-w7f9r"
Sep 09 15:56:13.054290 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:13.054239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:56:13.056695 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:13.056670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a5085d-b887-48ae-9152-d715e6d61760-metrics-tls\") pod \"dns-default-gbctk\" (UID: \"71a5085d-b887-48ae-9152-d715e6d61760\") " pod="openshift-dns/dns-default-gbctk"
Sep 09 15:56:13.178904 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:13.178863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xfw9\""
Sep 09 15:56:13.186795 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:13.186769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbctk"
Sep 09 15:56:13.457595 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:13.457561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbctk"]
Sep 09 15:56:13.460498 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:13.460469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a5085d_b887_48ae_9152_d715e6d61760.slice/crio-826adccefc8b53af50431af9c0f72c5c515c18bcd253777f1b67199fcf69ea8a WatchSource:0}: Error finding container 826adccefc8b53af50431af9c0f72c5c515c18bcd253777f1b67199fcf69ea8a: Status 404 returned error can't find the container with id 826adccefc8b53af50431af9c0f72c5c515c18bcd253777f1b67199fcf69ea8a
Sep 09 15:56:14.190169 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:14.190130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbctk" event={"ID":"71a5085d-b887-48ae-9152-d715e6d61760","Type":"ContainerStarted","Data":"826adccefc8b53af50431af9c0f72c5c515c18bcd253777f1b67199fcf69ea8a"}
Sep 09 15:56:14.536088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:14.536048    2578 patch_prober.go:28] interesting pod/image-registry-df7bd8756-bn88q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 15:56:14.536279 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:14.536109    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 15:56:15.071016 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:15.070961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:56:15.073374 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:15.073335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-64pkg\" (UID: \"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb\") " pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:56:15.297468 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:15.297424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-64pkg"
Sep 09 15:56:15.568535 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:15.568501    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-64pkg"]
Sep 09 15:56:15.571749 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:15.571720    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bad9cd4_ee7b_4099_9d5d_18b15c4e11bb.slice/crio-19cc238a7ddd9048154ffcf08c179cd6fca32b92035e5c2466648e72411613b6 WatchSource:0}: Error finding container 19cc238a7ddd9048154ffcf08c179cd6fca32b92035e5c2466648e72411613b6: Status 404 returned error can't find the container with id 19cc238a7ddd9048154ffcf08c179cd6fca32b92035e5c2466648e72411613b6
Sep 09 15:56:16.199698 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:16.199665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-64pkg" event={"ID":"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb","Type":"ContainerStarted","Data":"7066fe7796b85d9547b61e5ce9925c254a1892bcfc4b089f7fbd6f8e6c564eb7"}
Sep 09 15:56:16.199906 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:16.199736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-64pkg" event={"ID":"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb","Type":"ContainerStarted","Data":"19cc238a7ddd9048154ffcf08c179cd6fca32b92035e5c2466648e72411613b6"}
Sep 09 15:56:17.205781 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:17.205741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-64pkg" event={"ID":"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb","Type":"ContainerStarted","Data":"915bb5ef71f3938cb10fbd74ce72d5c7779cc5b659d68af80657cd02704356b5"}
Sep 09 15:56:18.212276 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:18.212223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbctk" event={"ID":"71a5085d-b887-48ae-9152-d715e6d61760","Type":"ContainerStarted","Data":"69d5fb5fea218a6e3f546a492854db5d9003481858c6ee4e0befa4e90af86f2c"}
Sep 09 15:56:18.212718 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:18.212293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbctk" event={"ID":"71a5085d-b887-48ae-9152-d715e6d61760","Type":"ContainerStarted","Data":"09059d32ad6eb0e13b672a8f20a15ac401d100f46b2a9bfc8749376b57a6991a"}
Sep 09 15:56:18.212718 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:18.212365    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gbctk"
Sep 09 15:56:18.230766 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:18.230711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gbctk" podStartSLOduration=250.704999899 podStartE2EDuration="4m15.23069395s" totalImagesPullingTime="4.525694051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:18.230093382 +0000 UTC m=+289.491222555" watchObservedRunningTime="2026-09-09 15:56:18.23069395 +0000 UTC m=+289.491823126"
Sep 09 15:56:21.226604 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.226570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-64pkg" event={"ID":"3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb","Type":"ContainerStarted","Data":"411a78269e2f5f75f26636ad9a8466c14ba2b8c9300d9bf2476f6801636df922"}
Sep 09 15:56:21.244892 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.244839    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-64pkg" podStartSLOduration=33.196097199 podStartE2EDuration="38.24482179s" totalImagesPullingTime="5.048724591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 15:55:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:21.243792537 +0000 UTC m=+292.504921712" watchObservedRunningTime="2026-09-09 15:56:21.24482179 +0000 UTC m=+292.505950966"
Sep 09 15:56:21.362430 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:21.362382    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9l5kb" podUID="7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b"
Sep 09 15:56:21.379652 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.379611    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d98c659cb-h2x67"]
Sep 09 15:56:21.382723 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.382694    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.385331 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 15:56:21.385331 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385303    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2p968\""
Sep 09 15:56:21.385331 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385325    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 15:56:21.385735 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385326    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 15:56:21.385735 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385414    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 15:56:21.385735 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385705    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 15:56:21.385893 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.385764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 15:56:21.386402 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.386383    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 15:56:21.390820 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.390796    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 15:56:21.392228 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.392206    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d98c659cb-h2x67"]
Sep 09 15:56:21.525635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-trusted-ca-bundle\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.525635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-console-config\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.525635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-service-ca\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.525635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-serving-cert\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.525898 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfnjw\" (UniqueName: \"kubernetes.io/projected/f1bb10da-8829-4638-8789-e76ada415a15-kube-api-access-nfnjw\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.525898 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-oauth-serving-cert\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.525898 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.525748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-oauth-config\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626321 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfnjw\" (UniqueName: \"kubernetes.io/projected/f1bb10da-8829-4638-8789-e76ada415a15-kube-api-access-nfnjw\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626321 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-oauth-serving-cert\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626614 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-oauth-config\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626614 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-trusted-ca-bundle\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626614 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-console-config\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626614 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-service-ca\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.626614 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.626495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-serving-cert\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.627195 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.627159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-console-config\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.627297 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.627193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-oauth-serving-cert\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.627297 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.627244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-service-ca\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.627432 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.627331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-trusted-ca-bundle\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.633099 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.629220    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-serving-cert\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.633099 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.629270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-oauth-config\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.636132 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.636104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfnjw\" (UniqueName: \"kubernetes.io/projected/f1bb10da-8829-4638-8789-e76ada415a15-kube-api-access-nfnjw\") pod \"console-5d98c659cb-h2x67\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") " pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.692814 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.692776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:21.967400 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:21.967366    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d98c659cb-h2x67"]
Sep 09 15:56:21.971168 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:21.971135    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bb10da_8829_4638_8789_e76ada415a15.slice/crio-9feb66356bd70d763ddf1c473d5b682e66e5fccdc4b5a6005b23d064f35fe0ed WatchSource:0}: Error finding container 9feb66356bd70d763ddf1c473d5b682e66e5fccdc4b5a6005b23d064f35fe0ed: Status 404 returned error can't find the container with id 9feb66356bd70d763ddf1c473d5b682e66e5fccdc4b5a6005b23d064f35fe0ed
Sep 09 15:56:22.231008 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:22.230923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d98c659cb-h2x67" event={"ID":"f1bb10da-8829-4638-8789-e76ada415a15","Type":"ContainerStarted","Data":"9feb66356bd70d763ddf1c473d5b682e66e5fccdc4b5a6005b23d064f35fe0ed"}
Sep 09 15:56:24.535147 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:24.535101    2578 patch_prober.go:28] interesting pod/image-registry-df7bd8756-bn88q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 15:56:24.535564 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:24.535163    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 15:56:24.888919 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:24.888884    2578 patch_prober.go:28] interesting pod/image-registry-66867985d6-jq2lj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 15:56:24.889084 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:24.888940    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66867985d6-jq2lj" podUID="54fc8590-8a0a-4651-ba47-5b1cbcd25ae9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 15:56:25.242804 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:25.242768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d98c659cb-h2x67" event={"ID":"f1bb10da-8829-4638-8789-e76ada415a15","Type":"ContainerStarted","Data":"abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665"}
Sep 09 15:56:25.258493 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:25.258444    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d98c659cb-h2x67" podStartSLOduration=1.433062301 podStartE2EDuration="4.258427405s" totalImagesPullingTime="2.825365104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:25.257842246 +0000 UTC m=+296.518971423" watchObservedRunningTime="2026-09-09 15:56:25.258427405 +0000 UTC m=+296.519556581"
Sep 09 15:56:27.169465 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:27.169433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66867985d6-jq2lj"
Sep 09 15:56:28.217780 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:28.217745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gbctk"
Sep 09 15:56:29.109224 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.109186    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"]
Sep 09 15:56:29.113856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.113832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.116425 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.116404    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 15:56:29.116553 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.116404    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 15:56:29.116553 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.116404    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 15:56:29.116553 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.116423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 15:56:29.117520 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.117500    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 15:56:29.117629 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.117560    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v2wlr\""
Sep 09 15:56:29.121472 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.121452    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"]
Sep 09 15:56:29.127051 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.127031    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 15:56:29.189293 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.189264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d719d7f-eaeb-4490-82da-038fd28eaaf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.189406 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.189321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfjn9\" (UniqueName: \"kubernetes.io/projected/9d719d7f-eaeb-4490-82da-038fd28eaaf7-kube-api-access-tfjn9\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.189450 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.189400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d719d7f-eaeb-4490-82da-038fd28eaaf7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.189450 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.189437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d719d7f-eaeb-4490-82da-038fd28eaaf7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.290854 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.290719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d719d7f-eaeb-4490-82da-038fd28eaaf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.290854 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.290783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfjn9\" (UniqueName: \"kubernetes.io/projected/9d719d7f-eaeb-4490-82da-038fd28eaaf7-kube-api-access-tfjn9\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.290854 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.290817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d719d7f-eaeb-4490-82da-038fd28eaaf7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.306703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.290856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d719d7f-eaeb-4490-82da-038fd28eaaf7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.306703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.291500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d719d7f-eaeb-4490-82da-038fd28eaaf7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.306703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.293119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d719d7f-eaeb-4490-82da-038fd28eaaf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.306703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.293275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d719d7f-eaeb-4490-82da-038fd28eaaf7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.306703 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.298840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfjn9\" (UniqueName: \"kubernetes.io/projected/9d719d7f-eaeb-4490-82da-038fd28eaaf7-kube-api-access-tfjn9\") pod \"prometheus-operator-6f4946db56-9nvfr\" (UID: \"9d719d7f-eaeb-4490-82da-038fd28eaaf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.425859 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.425814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"
Sep 09 15:56:29.548886 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.548850    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerName="registry" containerID="cri-o://a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8" gracePeriod=30
Sep 09 15:56:29.694992 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.694844    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9nvfr"]
Sep 09 15:56:29.697181 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:29.697155    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d719d7f_eaeb_4490_82da_038fd28eaaf7.slice/crio-86f4c66c66539e081f5f9091b89969605c34cdfaa6def0ff06c5b4067e8f1daa WatchSource:0}: Error finding container 86f4c66c66539e081f5f9091b89969605c34cdfaa6def0ff06c5b4067e8f1daa: Status 404 returned error can't find the container with id 86f4c66c66539e081f5f9091b89969605c34cdfaa6def0ff06c5b4067e8f1daa
Sep 09 15:56:29.778764 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.778743    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:56:29.894396 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894368    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-certificates\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07b4ffb8-d586-4168-bba1-75baabbb65f3-ca-trust-extracted\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894548 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-trusted-ca\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894716 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894565    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klgdb\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-kube-api-access-klgdb\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894716 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-image-registry-private-configuration\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894716 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-installation-pull-secrets\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894716 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894659    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-bound-sa-token\") pod \"07b4ffb8-d586-4168-bba1-75baabbb65f3\" (UID: \"07b4ffb8-d586-4168-bba1-75baabbb65f3\") "
Sep 09 15:56:29.894911 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894857    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:56:29.895007 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.894978    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:56:29.896654 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.896625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:56:29.896654 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.896643    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:56:29.897018 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.897000    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:56:29.897130 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.897112    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-kube-api-access-klgdb" (OuterVolumeSpecName: "kube-api-access-klgdb") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "kube-api-access-klgdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:56:29.897170 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.897128    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:56:29.903019 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.902999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b4ffb8-d586-4168-bba1-75baabbb65f3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "07b4ffb8-d586-4168-bba1-75baabbb65f3" (UID: "07b4ffb8-d586-4168-bba1-75baabbb65f3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 15:56:29.995404 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995378    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-trusted-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995404 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995399    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klgdb\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-kube-api-access-klgdb\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995536 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995409    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-image-registry-private-configuration\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995536 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995418    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07b4ffb8-d586-4168-bba1-75baabbb65f3-installation-pull-secrets\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995536 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995427    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-bound-sa-token\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995536 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995435    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995536 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995443    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07b4ffb8-d586-4168-bba1-75baabbb65f3-registry-certificates\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:29.995536 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:29.995451    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07b4ffb8-d586-4168-bba1-75baabbb65f3-ca-trust-extracted\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:56:30.259800 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.259708    2578 generic.go:356] "Generic (PLEG): container finished" podID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerID="a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8" exitCode=0
Sep 09 15:56:30.259800 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.259770    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7bd8756-bn88q"
Sep 09 15:56:30.260023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.259800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" event={"ID":"07b4ffb8-d586-4168-bba1-75baabbb65f3","Type":"ContainerDied","Data":"a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8"}
Sep 09 15:56:30.260023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.259891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7bd8756-bn88q" event={"ID":"07b4ffb8-d586-4168-bba1-75baabbb65f3","Type":"ContainerDied","Data":"5f2306e73c1bed1b595df4184e23c79b02c5e5a8f74e7461f773e286a702f38d"}
Sep 09 15:56:30.260878 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.260859    2578 scope.go:117] "RemoveContainer" containerID="a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8"
Sep 09 15:56:30.261044 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.261022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr" event={"ID":"9d719d7f-eaeb-4490-82da-038fd28eaaf7","Type":"ContainerStarted","Data":"86f4c66c66539e081f5f9091b89969605c34cdfaa6def0ff06c5b4067e8f1daa"}
Sep 09 15:56:30.269336 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.269314    2578 scope.go:117] "RemoveContainer" containerID="a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8"
Sep 09 15:56:30.269656 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:30.269637    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8\": container with ID starting with a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8 not found: ID does not exist" containerID="a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8"
Sep 09 15:56:30.269712 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.269665    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8"} err="failed to get container status \"a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8\": rpc error: code = NotFound desc = could not find container \"a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8\": container with ID starting with a02aaa3dedb443cc3bf0b76697b20d9657473601bac4f95e225b1fa1ea8c44c8 not found: ID does not exist"
Sep 09 15:56:30.280126 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.280097    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df7bd8756-bn88q"]
Sep 09 15:56:30.283930 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:30.283905    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-df7bd8756-bn88q"]
Sep 09 15:56:31.265748 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.265649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr" event={"ID":"9d719d7f-eaeb-4490-82da-038fd28eaaf7","Type":"ContainerStarted","Data":"ebda544904c71cc3335661d8adf047892d571c19147c6b786a58d5bb004299db"}
Sep 09 15:56:31.265748 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.265708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr" event={"ID":"9d719d7f-eaeb-4490-82da-038fd28eaaf7","Type":"ContainerStarted","Data":"a01da670ec89385be26678df92534a2bd3131063f106b48d2794247486fa85df"}
Sep 09 15:56:31.283451 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.283401    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-9nvfr" podStartSLOduration=1.019397597 podStartE2EDuration="2.283385046s" totalImagesPullingTime="1.263987449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:31.281664741 +0000 UTC m=+302.542793917" watchObservedRunningTime="2026-09-09 15:56:31.283385046 +0000 UTC m=+302.544514221"
Sep 09 15:56:31.366321 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.366289    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" path="/var/lib/kubelet/pods/07b4ffb8-d586-4168-bba1-75baabbb65f3/volumes"
Sep 09 15:56:31.692989 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.692892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:31.692989 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.692959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:31.697726 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:31.697707    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:32.273705 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:32.273675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:56:33.362041 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.362011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:56:33.446575 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.446543    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"]
Sep 09 15:56:33.446768 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.446757    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerName="registry"
Sep 09 15:56:33.446811 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.446769    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerName="registry"
Sep 09 15:56:33.446844 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.446815    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b4ffb8-d586-4168-bba1-75baabbb65f3" containerName="registry"
Sep 09 15:56:33.449937 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.449921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.452266 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.452243    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 15:56:33.452396 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.452284    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 15:56:33.452466 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.452428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zvg89\""
Sep 09 15:56:33.458334 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.458307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"]
Sep 09 15:56:33.477047 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.477024    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-84z7g"]
Sep 09 15:56:33.479940 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.479925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.483058 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.483039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 15:56:33.483166 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.483078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 15:56:33.483166 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.483158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 15:56:33.483303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.483287    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pqjbj\""
Sep 09 15:56:33.525372 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.525323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.525518 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.525405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.525518 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.525434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/615a6b98-a497-4cb1-8ef6-0210ec02d755-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.525518 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.525488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbrn8\" (UniqueName: \"kubernetes.io/projected/615a6b98-a497-4cb1-8ef6-0210ec02d755-kube-api-access-sbrn8\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.626892 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.626816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbrn8\" (UniqueName: \"kubernetes.io/projected/615a6b98-a497-4cb1-8ef6-0210ec02d755-kube-api-access-sbrn8\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.626892 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.626864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-wtmp\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.626892 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.626882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.626902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-root\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.626968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-accelerators-collector-config\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7sw\" (UniqueName: \"kubernetes.io/projected/7583047d-1d22-4fd0-8973-992336708cf9-kube-api-access-fx7sw\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-tls\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-sys\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627103 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.627467 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-textfile\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627467 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/615a6b98-a497-4cb1-8ef6-0210ec02d755-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.627467 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7583047d-1d22-4fd0-8973-992336708cf9-metrics-client-ca\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.627467 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:33.627192    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 09 15:56:33.627467 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:33.627240    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-tls podName:615a6b98-a497-4cb1-8ef6-0210ec02d755 nodeName:}" failed. No retries permitted until 2026-09-09 15:56:34.127226082 +0000 UTC m=+305.388355237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-6wrkr" (UID: "615a6b98-a497-4cb1-8ef6-0210ec02d755") : secret "openshift-state-metrics-tls" not found
Sep 09 15:56:33.627771 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.627754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/615a6b98-a497-4cb1-8ef6-0210ec02d755-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.629430 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.629410    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.636810 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.636789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbrn8\" (UniqueName: \"kubernetes.io/projected/615a6b98-a497-4cb1-8ef6-0210ec02d755-kube-api-access-sbrn8\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:33.728486 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7sw\" (UniqueName: \"kubernetes.io/projected/7583047d-1d22-4fd0-8973-992336708cf9-kube-api-access-fx7sw\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728576 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-tls\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728576 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-sys\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728576 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-textfile\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728682 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7583047d-1d22-4fd0-8973-992336708cf9-metrics-client-ca\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728682 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:33.728598    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 15:56:33.728682 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-sys\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728809 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:56:33.728685    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-tls podName:7583047d-1d22-4fd0-8973-992336708cf9 nodeName:}" failed. No retries permitted until 2026-09-09 15:56:34.228656752 +0000 UTC m=+305.489785909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-tls") pod "node-exporter-84z7g" (UID: "7583047d-1d22-4fd0-8973-992336708cf9") : secret "node-exporter-tls" not found
Sep 09 15:56:33.728809 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-wtmp\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728809 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728809 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-root\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728809 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-accelerators-collector-config\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728997 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-root\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728997 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-wtmp\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.728997 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.728947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-textfile\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.729243 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.729226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-accelerators-collector-config\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.729584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.729568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7583047d-1d22-4fd0-8973-992336708cf9-metrics-client-ca\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.730846 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.730819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:33.737974 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:33.737953    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7sw\" (UniqueName: \"kubernetes.io/projected/7583047d-1d22-4fd0-8973-992336708cf9-kube-api-access-fx7sw\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:34.133028 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.132990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:34.135334 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.135310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/615a6b98-a497-4cb1-8ef6-0210ec02d755-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6wrkr\" (UID: \"615a6b98-a497-4cb1-8ef6-0210ec02d755\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:34.233980 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.233951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-tls\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:34.236108 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.236083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7583047d-1d22-4fd0-8973-992336708cf9-node-exporter-tls\") pod \"node-exporter-84z7g\" (UID: \"7583047d-1d22-4fd0-8973-992336708cf9\") " pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:34.359085 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.359058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"
Sep 09 15:56:34.388251 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.388188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-84z7g"
Sep 09 15:56:34.401531 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:34.401503    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7583047d_1d22_4fd0_8973_992336708cf9.slice/crio-10021fc3ede316bf1ef46bd104d12877e527e88cf5707bc724837d20a0b2a563 WatchSource:0}: Error finding container 10021fc3ede316bf1ef46bd104d12877e527e88cf5707bc724837d20a0b2a563: Status 404 returned error can't find the container with id 10021fc3ede316bf1ef46bd104d12877e527e88cf5707bc724837d20a0b2a563
Sep 09 15:56:34.403767 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.403749    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 15:56:34.633537 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:34.633420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr"]
Sep 09 15:56:34.638645 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:34.638581    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615a6b98_a497_4cb1_8ef6_0210ec02d755.slice/crio-e8a51ce6850b927c3b0548e057c3a2f453cf0ab54397169dcaf12f26b557cbd5 WatchSource:0}: Error finding container e8a51ce6850b927c3b0548e057c3a2f453cf0ab54397169dcaf12f26b557cbd5: Status 404 returned error can't find the container with id e8a51ce6850b927c3b0548e057c3a2f453cf0ab54397169dcaf12f26b557cbd5
Sep 09 15:56:35.280450 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:35.280417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84z7g" event={"ID":"7583047d-1d22-4fd0-8973-992336708cf9","Type":"ContainerStarted","Data":"10021fc3ede316bf1ef46bd104d12877e527e88cf5707bc724837d20a0b2a563"}
Sep 09 15:56:35.282324 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:35.282299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr" event={"ID":"615a6b98-a497-4cb1-8ef6-0210ec02d755","Type":"ContainerStarted","Data":"c72fcb9f1bc81e79c6b45f1cdcf683c06de9a675ba73c91e807c5efd2e492cf7"}
Sep 09 15:56:35.282451 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:35.282341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr" event={"ID":"615a6b98-a497-4cb1-8ef6-0210ec02d755","Type":"ContainerStarted","Data":"b6224ead10b10ce6e9f4bf6e25304e392da95fa4afc8142df4b7ee7663b2b89b"}
Sep 09 15:56:35.282451 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:35.282374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr" event={"ID":"615a6b98-a497-4cb1-8ef6-0210ec02d755","Type":"ContainerStarted","Data":"e8a51ce6850b927c3b0548e057c3a2f453cf0ab54397169dcaf12f26b557cbd5"}
Sep 09 15:56:37.291732 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.291691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr" event={"ID":"615a6b98-a497-4cb1-8ef6-0210ec02d755","Type":"ContainerStarted","Data":"cd055529690a2291db66ec7f7a241fdba29f2434d3da6d1a3dbeeaa68e294774"}
Sep 09 15:56:37.309196 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.309142    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6wrkr" podStartSLOduration=2.822072496 podStartE2EDuration="4.309121946s" totalImagesPullingTime="1.48704945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:37.307683122 +0000 UTC m=+308.568812300" watchObservedRunningTime="2026-09-09 15:56:37.309121946 +0000 UTC m=+308.570251123"
Sep 09 15:56:37.933260 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.933216    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6584bb4c58-p2nf9"]
Sep 09 15:56:37.936985 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.936962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:37.940742 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.940716    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 15:56:37.940879 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.940749    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2htt6\""
Sep 09 15:56:37.940879 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.940760    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 15:56:37.940879 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.940716    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 15:56:37.940879 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.940763    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 15:56:37.941050 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.940879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fki0rpirspi9t\""
Sep 09 15:56:37.944262 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:37.944198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6584bb4c58-p2nf9"]
Sep 09 15:56:38.063498 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6eeca564-4767-4295-96fe-68fa003d7811-metrics-server-audit-profiles\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.063498 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6eeca564-4767-4295-96fe-68fa003d7811-audit-log\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.063681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-client-ca-bundle\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.063681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eeca564-4767-4295-96fe-68fa003d7811-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.063681 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w666s\" (UniqueName: \"kubernetes.io/projected/6eeca564-4767-4295-96fe-68fa003d7811-kube-api-access-w666s\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.063798 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-secret-metrics-server-tls\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.063798 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.063734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-secret-metrics-server-client-certs\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164324 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6eeca564-4767-4295-96fe-68fa003d7811-audit-log\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164324 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-client-ca-bundle\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164572 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eeca564-4767-4295-96fe-68fa003d7811-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164572 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w666s\" (UniqueName: \"kubernetes.io/projected/6eeca564-4767-4295-96fe-68fa003d7811-kube-api-access-w666s\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164572 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-secret-metrics-server-tls\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164725 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-secret-metrics-server-client-certs\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164725 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6eeca564-4767-4295-96fe-68fa003d7811-metrics-server-audit-profiles\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.164896 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.164861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6eeca564-4767-4295-96fe-68fa003d7811-audit-log\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.165290 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.165262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eeca564-4767-4295-96fe-68fa003d7811-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.165562 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.165542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6eeca564-4767-4295-96fe-68fa003d7811-metrics-server-audit-profiles\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.166932 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.166899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-client-ca-bundle\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.167025 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.166967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-secret-metrics-server-client-certs\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.167087 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.167037    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6eeca564-4767-4295-96fe-68fa003d7811-secret-metrics-server-tls\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.171477 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.171459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w666s\" (UniqueName: \"kubernetes.io/projected/6eeca564-4767-4295-96fe-68fa003d7811-kube-api-access-w666s\") pod \"metrics-server-6584bb4c58-p2nf9\" (UID: \"6eeca564-4767-4295-96fe-68fa003d7811\") " pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.246394 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.246359    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"]
Sep 09 15:56:38.247598 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.247574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:38.250570 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.250549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.255565 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.255538    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 15:56:38.255856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.255832    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t24w9\""
Sep 09 15:56:38.257385 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.257343    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5445d9f45c-4ncc2"]
Sep 09 15:56:38.261171 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.261150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"]
Sep 09 15:56:38.261302 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.261285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.268886 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.268857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5445d9f45c-4ncc2"]
Sep 09 15:56:38.366926 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.366878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-trusted-ca-bundle\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-serving-cert\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-service-ca\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-config\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxlvv\" (UniqueName: \"kubernetes.io/projected/d4711d0e-8c39-44f1-9234-e5299fa3da85-kube-api-access-fxlvv\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ttpgj\" (UID: \"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh42\" (UniqueName: \"kubernetes.io/projected/a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8-kube-api-access-9wh42\") pod \"monitoring-plugin-85bbbbbf4-ttpgj\" (UID: \"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.367414 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-oauth-config\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.367688 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.367438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-oauth-serving-cert\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468311 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-serving-cert\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468311 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-service-ca\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-config\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxlvv\" (UniqueName: \"kubernetes.io/projected/d4711d0e-8c39-44f1-9234-e5299fa3da85-kube-api-access-fxlvv\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ttpgj\" (UID: \"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.468746 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh42\" (UniqueName: \"kubernetes.io/projected/a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8-kube-api-access-9wh42\") pod \"monitoring-plugin-85bbbbbf4-ttpgj\" (UID: \"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.468746 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-oauth-config\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468746 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-oauth-serving-cert\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.468746 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.468728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-trusted-ca-bundle\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.469186 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.469132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-config\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.469186 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.469170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-service-ca\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.469619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.469590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-oauth-serving-cert\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.469706 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.469664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-trusted-ca-bundle\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.471129 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.471109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ttpgj\" (UID: \"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.471283 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.471261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-oauth-config\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.471380 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.471340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-serving-cert\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.477367 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.477317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxlvv\" (UniqueName: \"kubernetes.io/projected/d4711d0e-8c39-44f1-9234-e5299fa3da85-kube-api-access-fxlvv\") pod \"console-5445d9f45c-4ncc2\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") " pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:38.477463 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.477452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh42\" (UniqueName: \"kubernetes.io/projected/a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8-kube-api-access-9wh42\") pod \"monitoring-plugin-85bbbbbf4-ttpgj\" (UID: \"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.534285 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.534210    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6584bb4c58-p2nf9"]
Sep 09 15:56:38.537730 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:38.537703    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeca564_4767_4295_96fe_68fa003d7811.slice/crio-af1cb57c23ec2e3333e58c89d5126ba50f4d2ddeac38b3f99ed333a737f76207 WatchSource:0}: Error finding container af1cb57c23ec2e3333e58c89d5126ba50f4d2ddeac38b3f99ed333a737f76207: Status 404 returned error can't find the container with id af1cb57c23ec2e3333e58c89d5126ba50f4d2ddeac38b3f99ed333a737f76207
Sep 09 15:56:38.578448 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.578424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:38.587670 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:38.587633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:39.057370 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.057328    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"]
Sep 09 15:56:39.060151 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:39.060055    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda332eb9c_b3ad_41a4_a4e4_a2ed26b561b8.slice/crio-3a595d05adbbc584ac725b17d5e95f4033dc3381d57c60d191ecec7cffd5acae WatchSource:0}: Error finding container 3a595d05adbbc584ac725b17d5e95f4033dc3381d57c60d191ecec7cffd5acae: Status 404 returned error can't find the container with id 3a595d05adbbc584ac725b17d5e95f4033dc3381d57c60d191ecec7cffd5acae
Sep 09 15:56:39.060392 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.060375    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5445d9f45c-4ncc2"]
Sep 09 15:56:39.062494 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:56:39.062473    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4711d0e_8c39_44f1_9234_e5299fa3da85.slice/crio-9b8ce339905bd594b40945c5723acac5217508260ce6f9c6ce828eefdaf1b559 WatchSource:0}: Error finding container 9b8ce339905bd594b40945c5723acac5217508260ce6f9c6ce828eefdaf1b559: Status 404 returned error can't find the container with id 9b8ce339905bd594b40945c5723acac5217508260ce6f9c6ce828eefdaf1b559
Sep 09 15:56:39.301738 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.301699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj" event={"ID":"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8","Type":"ContainerStarted","Data":"3a595d05adbbc584ac725b17d5e95f4033dc3381d57c60d191ecec7cffd5acae"}
Sep 09 15:56:39.303514 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.303485    2578 generic.go:356] "Generic (PLEG): container finished" podID="7583047d-1d22-4fd0-8973-992336708cf9" containerID="4d8a22a42ecd228940d0f4803ba1ca321e1d334fc327447b4cc931f5fd7163b5" exitCode=0
Sep 09 15:56:39.303642 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.303573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84z7g" event={"ID":"7583047d-1d22-4fd0-8973-992336708cf9","Type":"ContainerDied","Data":"4d8a22a42ecd228940d0f4803ba1ca321e1d334fc327447b4cc931f5fd7163b5"}
Sep 09 15:56:39.305184 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.305157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9" event={"ID":"6eeca564-4767-4295-96fe-68fa003d7811","Type":"ContainerStarted","Data":"af1cb57c23ec2e3333e58c89d5126ba50f4d2ddeac38b3f99ed333a737f76207"}
Sep 09 15:56:39.307028 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.306981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445d9f45c-4ncc2" event={"ID":"d4711d0e-8c39-44f1-9234-e5299fa3da85","Type":"ContainerStarted","Data":"a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc"}
Sep 09 15:56:39.307028 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.307021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445d9f45c-4ncc2" event={"ID":"d4711d0e-8c39-44f1-9234-e5299fa3da85","Type":"ContainerStarted","Data":"9b8ce339905bd594b40945c5723acac5217508260ce6f9c6ce828eefdaf1b559"}
Sep 09 15:56:39.337232 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:39.337187    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5445d9f45c-4ncc2" podStartSLOduration=1.337171353 podStartE2EDuration="1.337171353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:39.335674685 +0000 UTC m=+310.596803860" watchObservedRunningTime="2026-09-09 15:56:39.337171353 +0000 UTC m=+310.598300585"
Sep 09 15:56:40.313416 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:40.313377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84z7g" event={"ID":"7583047d-1d22-4fd0-8973-992336708cf9","Type":"ContainerStarted","Data":"1bb2acdd98e51e37c0e804628d2111d6eba24ba3378580056a4f2cbaa09bc8ab"}
Sep 09 15:56:40.313965 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:40.313440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84z7g" event={"ID":"7583047d-1d22-4fd0-8973-992336708cf9","Type":"ContainerStarted","Data":"a7b38bc7db0671f8ea436ac018524e9cb7ad3f44350f36c4c6f2695db416caa5"}
Sep 09 15:56:40.314924 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:40.314903    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9" event={"ID":"6eeca564-4767-4295-96fe-68fa003d7811","Type":"ContainerStarted","Data":"36a3c5e909681b2c32bf30cfef61c6abbe6e2563a3d65b938781910fd17eb0a6"}
Sep 09 15:56:40.349680 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:40.349637    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9" podStartSLOduration=1.7262950510000001 podStartE2EDuration="3.349624583s" totalImagesPullingTime="1.623329532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:40.348912188 +0000 UTC m=+311.610041364" watchObservedRunningTime="2026-09-09 15:56:40.349624583 +0000 UTC m=+311.610753759"
Sep 09 15:56:40.350169 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:40.350146    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-84z7g" podStartSLOduration=2.862522669 podStartE2EDuration="7.350139405s" totalImagesPullingTime="4.427024702s" totalInitContainerRuntime="60.592034ms" isStatefulPod=true podCreationTimestamp="2026-09-09 15:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:40.330781882 +0000 UTC m=+311.591911058" watchObservedRunningTime="2026-09-09 15:56:40.350139405 +0000 UTC m=+311.611268590"
Sep 09 15:56:47.342985 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:47.342949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj" event={"ID":"a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8","Type":"ContainerStarted","Data":"cbd9d4df86fc69dfc3f38c078a5109e1ae01087f871465034cf8014700d49328"}
Sep 09 15:56:47.343411 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:47.343099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:47.348304 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:47.348275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj"
Sep 09 15:56:47.358660 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:47.358617    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ttpgj" podStartSLOduration=1.6119441810000001 podStartE2EDuration="9.358602677s" totalImagesPullingTime="7.746658496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:56:47.358553486 +0000 UTC m=+318.619682662" watchObservedRunningTime="2026-09-09 15:56:47.358602677 +0000 UTC m=+318.619731853"
Sep 09 15:56:48.588598 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:48.588569    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:48.588992 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:48.588640    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:48.593288 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:48.593264    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:49.354002 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:49.353965    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:56:49.397435 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:49.397406    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d98c659cb-h2x67"]
Sep 09 15:56:58.248635 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:58.248596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:56:58.249034 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:56:58.248668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:57:08.418415 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:08.418382    2578 generic.go:356] "Generic (PLEG): container finished" podID="7dd47e64-abdc-4819-a238-8548a75af6b7" containerID="7c84c5a62a03d22ccb04f810b594d2a8fb9901b9a2c6b853e4e83f344e313200" exitCode=0
Sep 09 15:57:08.418789 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:08.418451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf" event={"ID":"7dd47e64-abdc-4819-a238-8548a75af6b7","Type":"ContainerDied","Data":"7c84c5a62a03d22ccb04f810b594d2a8fb9901b9a2c6b853e4e83f344e313200"}
Sep 09 15:57:08.418835 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:08.418798    2578 scope.go:117] "RemoveContainer" containerID="7c84c5a62a03d22ccb04f810b594d2a8fb9901b9a2c6b853e4e83f344e313200"
Sep 09 15:57:09.423610 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:09.423576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-25ztf" event={"ID":"7dd47e64-abdc-4819-a238-8548a75af6b7","Type":"ContainerStarted","Data":"2eb804c00af0e3c80186f24898d95ec26ddb5f61d0fdabd32f566010b62f71e0"}
Sep 09 15:57:14.418449 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.418407    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d98c659cb-h2x67" podUID="f1bb10da-8829-4638-8789-e76ada415a15" containerName="console" containerID="cri-o://abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665" gracePeriod=15
Sep 09 15:57:14.666119 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.666092    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:57:14.766291 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766255    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-console-config\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766496 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-oauth-serving-cert\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766496 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766365    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-serving-cert\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766496 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766381    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-oauth-config\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766496 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfnjw\" (UniqueName: \"kubernetes.io/projected/f1bb10da-8829-4638-8789-e76ada415a15-kube-api-access-nfnjw\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766496 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766437    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-trusted-ca-bundle\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766496 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766490    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-service-ca\") pod \"f1bb10da-8829-4638-8789-e76ada415a15\" (UID: \"f1bb10da-8829-4638-8789-e76ada415a15\") "
Sep 09 15:57:14.766809 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-console-config" (OuterVolumeSpecName: "console-config") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:57:14.766858 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.766822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:57:14.767031 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.767010    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:57:14.767105 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.767085    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:57:14.768802 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.768777    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:57:14.768906 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.768794    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bb10da-8829-4638-8789-e76ada415a15-kube-api-access-nfnjw" (OuterVolumeSpecName: "kube-api-access-nfnjw") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "kube-api-access-nfnjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:57:14.768906 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.768798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1bb10da-8829-4638-8789-e76ada415a15" (UID: "f1bb10da-8829-4638-8789-e76ada415a15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:57:14.867076 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867037    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfnjw\" (UniqueName: \"kubernetes.io/projected/f1bb10da-8829-4638-8789-e76ada415a15-kube-api-access-nfnjw\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:14.867076 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867070    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-trusted-ca-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:14.867076 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867083    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:14.867303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867096    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-console-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:14.867303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867107    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1bb10da-8829-4638-8789-e76ada415a15-oauth-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:14.867303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867118    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:14.867303 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:14.867129    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1bb10da-8829-4638-8789-e76ada415a15-console-oauth-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:57:15.446362 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.446317    2578 generic.go:356] "Generic (PLEG): container finished" podID="f1bb10da-8829-4638-8789-e76ada415a15" containerID="abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665" exitCode=0
Sep 09 15:57:15.446801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.446370    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d98c659cb-h2x67"
Sep 09 15:57:15.446801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.446381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d98c659cb-h2x67" event={"ID":"f1bb10da-8829-4638-8789-e76ada415a15","Type":"ContainerDied","Data":"abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665"}
Sep 09 15:57:15.446801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.446423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d98c659cb-h2x67" event={"ID":"f1bb10da-8829-4638-8789-e76ada415a15","Type":"ContainerDied","Data":"9feb66356bd70d763ddf1c473d5b682e66e5fccdc4b5a6005b23d064f35fe0ed"}
Sep 09 15:57:15.446801 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.446441    2578 scope.go:117] "RemoveContainer" containerID="abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665"
Sep 09 15:57:15.454278 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.454259    2578 scope.go:117] "RemoveContainer" containerID="abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665"
Sep 09 15:57:15.454555 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:57:15.454535    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665\": container with ID starting with abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665 not found: ID does not exist" containerID="abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665"
Sep 09 15:57:15.454607 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.454563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665"} err="failed to get container status \"abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665\": rpc error: code = NotFound desc = could not find container \"abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665\": container with ID starting with abfcdf951bcc3bd97d012170cbbfd34d06af9c8fa404d4ba5b7f975df557f665 not found: ID does not exist"
Sep 09 15:57:15.462062 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.462040    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d98c659cb-h2x67"]
Sep 09 15:57:15.465166 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:15.465146    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d98c659cb-h2x67"]
Sep 09 15:57:17.366622 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:17.366589    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1bb10da-8829-4638-8789-e76ada415a15" path="/var/lib/kubelet/pods/f1bb10da-8829-4638-8789-e76ada415a15/volumes"
Sep 09 15:57:18.253273 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:18.253235    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:57:18.257272 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:18.257255    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6584bb4c58-p2nf9"
Sep 09 15:57:18.458805 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:18.458767    2578 generic.go:356] "Generic (PLEG): container finished" podID="9e3d132d-dc7f-42ee-ae8c-88eab997c87b" containerID="4c78a1db5a5fc05184c138dfc06aa28ab914418c4c8b1d43973741a9afaa1fe8" exitCode=0
Sep 09 15:57:18.459271 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:18.458836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz" event={"ID":"9e3d132d-dc7f-42ee-ae8c-88eab997c87b","Type":"ContainerDied","Data":"4c78a1db5a5fc05184c138dfc06aa28ab914418c4c8b1d43973741a9afaa1fe8"}
Sep 09 15:57:18.459271 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:18.459271    2578 scope.go:117] "RemoveContainer" containerID="4c78a1db5a5fc05184c138dfc06aa28ab914418c4c8b1d43973741a9afaa1fe8"
Sep 09 15:57:19.464415 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:19.464382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8cmnz" event={"ID":"9e3d132d-dc7f-42ee-ae8c-88eab997c87b","Type":"ContainerStarted","Data":"9c5024d592ed5d07bc7b5bc91094d51acae45b6c9f612db7e76770ed7a866489"}
Sep 09 15:57:43.008742 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:43.008700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:57:43.010951 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:43.010921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b-metrics-certs\") pod \"network-metrics-daemon-9l5kb\" (UID: \"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b\") " pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:57:43.266187 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:43.266104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2dhs\""
Sep 09 15:57:43.273360 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:43.273326    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9l5kb"
Sep 09 15:57:43.558662 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:43.558582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9l5kb"]
Sep 09 15:57:43.561754 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:57:43.561729    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a939a9b_7a18_4dcc_a8a1_b21eeb99ae1b.slice/crio-40f677fdc9e0d1173e2fafdbc5475c93f7c0e15dbb37588dc120972cddc63927 WatchSource:0}: Error finding container 40f677fdc9e0d1173e2fafdbc5475c93f7c0e15dbb37588dc120972cddc63927: Status 404 returned error can't find the container with id 40f677fdc9e0d1173e2fafdbc5475c93f7c0e15dbb37588dc120972cddc63927
Sep 09 15:57:44.556421 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:44.556384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9l5kb" event={"ID":"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b","Type":"ContainerStarted","Data":"40f677fdc9e0d1173e2fafdbc5475c93f7c0e15dbb37588dc120972cddc63927"}
Sep 09 15:57:45.561640 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:45.561602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9l5kb" event={"ID":"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b","Type":"ContainerStarted","Data":"544911dba3a2d3a38173f157c11e7f8d0c4421c2c7073fff987935af799d571c"}
Sep 09 15:57:45.562107 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:45.561664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9l5kb" event={"ID":"7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b","Type":"ContainerStarted","Data":"03be4ba2cef3fb8c78214ea2a79ead81d20e3cfe2af7e4ae45937b18dbf2f689"}
Sep 09 15:57:45.579272 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:57:45.579203    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9l5kb" podStartSLOduration=374.582547746 podStartE2EDuration="6m15.579183959s" totalImagesPullingTime="996.636213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:57:45.577913104 +0000 UTC m=+376.839042330" watchObservedRunningTime="2026-09-09 15:57:45.579183959 +0000 UTC m=+376.840313135"
Sep 09 15:58:01.656132 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.656101    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-557c79f68f-zmlws"]
Sep 09 15:58:01.656565 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.656386    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bb10da-8829-4638-8789-e76ada415a15" containerName="console"
Sep 09 15:58:01.656565 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.656399    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bb10da-8829-4638-8789-e76ada415a15" containerName="console"
Sep 09 15:58:01.656565 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.656451    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1bb10da-8829-4638-8789-e76ada415a15" containerName="console"
Sep 09 15:58:01.659345 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.659329    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.669619 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.669593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c79f68f-zmlws"]
Sep 09 15:58:01.764552 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-config\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.764759 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-oauth-serving-cert\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.764759 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-oauth-config\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.764759 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-service-ca\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.764759 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjw45\" (UniqueName: \"kubernetes.io/projected/aeeccc26-24e4-4e35-8379-4ae903a3fb49-kube-api-access-tjw45\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.764983 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-trusted-ca-bundle\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.764983 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.764878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-serving-cert\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865666 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-serving-cert\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-config\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-oauth-serving-cert\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-oauth-config\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-service-ca\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjw45\" (UniqueName: \"kubernetes.io/projected/aeeccc26-24e4-4e35-8379-4ae903a3fb49-kube-api-access-tjw45\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.865856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.865846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-trusted-ca-bundle\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.866568 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.866536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-config\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.866794 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.866766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-oauth-serving-cert\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.866794 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.866796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-service-ca\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.866938 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.866779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-trusted-ca-bundle\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.868856 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.868832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-serving-cert\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.869592 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.869567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-oauth-config\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.873297 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.873276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjw45\" (UniqueName: \"kubernetes.io/projected/aeeccc26-24e4-4e35-8379-4ae903a3fb49-kube-api-access-tjw45\") pod \"console-557c79f68f-zmlws\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") " pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:01.969409 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:01.969369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:02.248261 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:02.248189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c79f68f-zmlws"]
Sep 09 15:58:02.250909 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:58:02.250875    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeeccc26_24e4_4e35_8379_4ae903a3fb49.slice/crio-900684fe5033023d66b0f5aff9113b2edba6b61d14409040b951f3e75297b7b9 WatchSource:0}: Error finding container 900684fe5033023d66b0f5aff9113b2edba6b61d14409040b951f3e75297b7b9: Status 404 returned error can't find the container with id 900684fe5033023d66b0f5aff9113b2edba6b61d14409040b951f3e75297b7b9
Sep 09 15:58:02.624395 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:02.624288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c79f68f-zmlws" event={"ID":"aeeccc26-24e4-4e35-8379-4ae903a3fb49","Type":"ContainerStarted","Data":"b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9"}
Sep 09 15:58:02.624395 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:02.624338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c79f68f-zmlws" event={"ID":"aeeccc26-24e4-4e35-8379-4ae903a3fb49","Type":"ContainerStarted","Data":"900684fe5033023d66b0f5aff9113b2edba6b61d14409040b951f3e75297b7b9"}
Sep 09 15:58:02.641054 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:02.640996    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-557c79f68f-zmlws" podStartSLOduration=1.6409800319999999 podStartE2EDuration="1.640980032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:58:02.640072673 +0000 UTC m=+393.901201850" watchObservedRunningTime="2026-09-09 15:58:02.640980032 +0000 UTC m=+393.902109277"
Sep 09 15:58:11.970409 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:11.970376    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:11.970897 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:11.970485    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:11.975280 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:11.975261    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:12.663962 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.663928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:12.703981 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.703950    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5445d9f45c-4ncc2"]
Sep 09 15:58:12.813811 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.813778    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f765c548b-kcb4d"]
Sep 09 15:58:12.818188 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.818168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.827475 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.827449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f765c548b-kcb4d"]
Sep 09 15:58:12.961397 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-config\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.961584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-serving-cert\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.961584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-service-ca\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.961584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-trusted-ca-bundle\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.961584 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwhf\" (UniqueName: \"kubernetes.io/projected/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-kube-api-access-8lwhf\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.961729 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-oauth-serving-cert\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:12.961729 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:12.961627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-oauth-config\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.062706 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-config\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-serving-cert\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-service-ca\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-trusted-ca-bundle\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwhf\" (UniqueName: \"kubernetes.io/projected/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-kube-api-access-8lwhf\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-oauth-serving-cert\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063156 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.062903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-oauth-config\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063614 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.063587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-service-ca\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.063684 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.063588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-config\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.064067 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.064043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-trusted-ca-bundle\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.064140 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.064043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-oauth-serving-cert\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.065186 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.065164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-oauth-config\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.065395 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.065376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-serving-cert\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.070645 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.070624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwhf\" (UniqueName: \"kubernetes.io/projected/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-kube-api-access-8lwhf\") pod \"console-f765c548b-kcb4d\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") " pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.127861 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.127824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:13.398792 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.398724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f765c548b-kcb4d"]
Sep 09 15:58:13.402337 ip-10-0-135-66 kubenswrapper[2578]: W0909 15:58:13.402307    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54951b39_4e73_4cda_9fa7_7e7b16ea2ebf.slice/crio-824c94ef0b8e40fcec9174c89908d4d23adf5b494710a186add90782bff59db0 WatchSource:0}: Error finding container 824c94ef0b8e40fcec9174c89908d4d23adf5b494710a186add90782bff59db0: Status 404 returned error can't find the container with id 824c94ef0b8e40fcec9174c89908d4d23adf5b494710a186add90782bff59db0
Sep 09 15:58:13.671843 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.671744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f765c548b-kcb4d" event={"ID":"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf","Type":"ContainerStarted","Data":"f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd"}
Sep 09 15:58:13.671843 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.671832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f765c548b-kcb4d" event={"ID":"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf","Type":"ContainerStarted","Data":"824c94ef0b8e40fcec9174c89908d4d23adf5b494710a186add90782bff59db0"}
Sep 09 15:58:13.691694 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:13.691640    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f765c548b-kcb4d" podStartSLOduration=1.691624969 podStartE2EDuration="1.691624969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 15:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 15:58:13.690851615 +0000 UTC m=+404.951980794" watchObservedRunningTime="2026-09-09 15:58:13.691624969 +0000 UTC m=+404.952754144"
Sep 09 15:58:23.128426 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:23.128341    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:23.128976 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:23.128450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:23.133253 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:23.133229    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:23.712462 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:23.712429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 15:58:23.757777 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:23.757745    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557c79f68f-zmlws"]
Sep 09 15:58:37.725381 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:37.725298    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5445d9f45c-4ncc2" podUID="d4711d0e-8c39-44f1-9234-e5299fa3da85" containerName="console" containerID="cri-o://a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc" gracePeriod=15
Sep 09 15:58:37.970956 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:37.970927    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:58:38.081114 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081026    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-oauth-serving-cert\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081114 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-config\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081345 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-serving-cert\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081345 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-oauth-config\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081345 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxlvv\" (UniqueName: \"kubernetes.io/projected/d4711d0e-8c39-44f1-9234-e5299fa3da85-kube-api-access-fxlvv\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081345 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-service-ca\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081345 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081323    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-trusted-ca-bundle\") pod \"d4711d0e-8c39-44f1-9234-e5299fa3da85\" (UID: \"d4711d0e-8c39-44f1-9234-e5299fa3da85\") "
Sep 09 15:58:38.081627 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:38.081627 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081516    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-config" (OuterVolumeSpecName: "console-config") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:38.081727 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081651    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-oauth-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.081727 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081670    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.081813 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081756    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:38.081857 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.081809    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:38.083286 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.083262    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:58:38.083737 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.083711    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:58:38.083737 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.083723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4711d0e-8c39-44f1-9234-e5299fa3da85-kube-api-access-fxlvv" (OuterVolumeSpecName: "kube-api-access-fxlvv") pod "d4711d0e-8c39-44f1-9234-e5299fa3da85" (UID: "d4711d0e-8c39-44f1-9234-e5299fa3da85"). InnerVolumeSpecName "kube-api-access-fxlvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:58:38.182446 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.182409    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.182446 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.182441    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4711d0e-8c39-44f1-9234-e5299fa3da85-console-oauth-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.182446 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.182451    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxlvv\" (UniqueName: \"kubernetes.io/projected/d4711d0e-8c39-44f1-9234-e5299fa3da85-kube-api-access-fxlvv\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.182728 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.182461    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.182728 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.182469    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4711d0e-8c39-44f1-9234-e5299fa3da85-trusted-ca-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:38.765621 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.765588    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4711d0e-8c39-44f1-9234-e5299fa3da85" containerID="a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc" exitCode=0
Sep 09 15:58:38.766023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.765633    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445d9f45c-4ncc2"
Sep 09 15:58:38.766023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.765642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445d9f45c-4ncc2" event={"ID":"d4711d0e-8c39-44f1-9234-e5299fa3da85","Type":"ContainerDied","Data":"a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc"}
Sep 09 15:58:38.766023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.765682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445d9f45c-4ncc2" event={"ID":"d4711d0e-8c39-44f1-9234-e5299fa3da85","Type":"ContainerDied","Data":"9b8ce339905bd594b40945c5723acac5217508260ce6f9c6ce828eefdaf1b559"}
Sep 09 15:58:38.766023 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.765700    2578 scope.go:117] "RemoveContainer" containerID="a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc"
Sep 09 15:58:38.773833 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.773811    2578 scope.go:117] "RemoveContainer" containerID="a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc"
Sep 09 15:58:38.774101 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:58:38.774083    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc\": container with ID starting with a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc not found: ID does not exist" containerID="a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc"
Sep 09 15:58:38.774162 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.774110    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc"} err="failed to get container status \"a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc\": rpc error: code = NotFound desc = could not find container \"a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc\": container with ID starting with a1b21959edcfe761db75ebb5103408d8be27fbc5aa22efcc8176b161d7d20edc not found: ID does not exist"
Sep 09 15:58:38.787114 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.787088    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5445d9f45c-4ncc2"]
Sep 09 15:58:38.788315 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:38.788297    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5445d9f45c-4ncc2"]
Sep 09 15:58:39.367160 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:39.367125    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4711d0e-8c39-44f1-9234-e5299fa3da85" path="/var/lib/kubelet/pods/d4711d0e-8c39-44f1-9234-e5299fa3da85/volumes"
Sep 09 15:58:48.785370 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:48.785321    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-557c79f68f-zmlws" podUID="aeeccc26-24e4-4e35-8379-4ae903a3fb49" containerName="console" containerID="cri-o://b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9" gracePeriod=15
Sep 09 15:58:49.031634 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.031608    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:49.173270 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-service-ca\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173270 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-trusted-ca-bundle\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173524 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173316    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-oauth-serving-cert\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173524 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173377    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjw45\" (UniqueName: \"kubernetes.io/projected/aeeccc26-24e4-4e35-8379-4ae903a3fb49-kube-api-access-tjw45\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173524 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-oauth-config\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173524 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173439    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-serving-cert\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173524 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-config\") pod \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\" (UID: \"aeeccc26-24e4-4e35-8379-4ae903a3fb49\") "
Sep 09 15:58:49.173772 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-service-ca" (OuterVolumeSpecName: "service-ca") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:49.173829 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173770    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:49.173829 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173788    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:49.173979 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.173961    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-config" (OuterVolumeSpecName: "console-config") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 15:58:49.175766 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.175738    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:58:49.175766 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.175757    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeeccc26-24e4-4e35-8379-4ae903a3fb49-kube-api-access-tjw45" (OuterVolumeSpecName: "kube-api-access-tjw45") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "kube-api-access-tjw45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 15:58:49.175953 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.175783    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aeeccc26-24e4-4e35-8379-4ae903a3fb49" (UID: "aeeccc26-24e4-4e35-8379-4ae903a3fb49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.274992    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.275025    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-trusted-ca-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.275037    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-oauth-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.275045    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjw45\" (UniqueName: \"kubernetes.io/projected/aeeccc26-24e4-4e35-8379-4ae903a3fb49-kube-api-access-tjw45\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.275055    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-oauth-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.275065    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.275088 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.275072    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeeccc26-24e4-4e35-8379-4ae903a3fb49-console-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 15:58:49.808908 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.808872    2578 generic.go:356] "Generic (PLEG): container finished" podID="aeeccc26-24e4-4e35-8379-4ae903a3fb49" containerID="b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9" exitCode=0
Sep 09 15:58:49.809320 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.808926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c79f68f-zmlws"
Sep 09 15:58:49.809320 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.808947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c79f68f-zmlws" event={"ID":"aeeccc26-24e4-4e35-8379-4ae903a3fb49","Type":"ContainerDied","Data":"b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9"}
Sep 09 15:58:49.809320 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.808998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c79f68f-zmlws" event={"ID":"aeeccc26-24e4-4e35-8379-4ae903a3fb49","Type":"ContainerDied","Data":"900684fe5033023d66b0f5aff9113b2edba6b61d14409040b951f3e75297b7b9"}
Sep 09 15:58:49.809320 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.809019    2578 scope.go:117] "RemoveContainer" containerID="b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9"
Sep 09 15:58:49.817071 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.817056    2578 scope.go:117] "RemoveContainer" containerID="b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9"
Sep 09 15:58:49.817370 ip-10-0-135-66 kubenswrapper[2578]: E0909 15:58:49.817335    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9\": container with ID starting with b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9 not found: ID does not exist" containerID="b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9"
Sep 09 15:58:49.817420 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.817379    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9"} err="failed to get container status \"b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9\": rpc error: code = NotFound desc = could not find container \"b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9\": container with ID starting with b4f9398f40ac9712b9a85e5c9f1b5414e6f65226003b01d40c84ea47a00980e9 not found: ID does not exist"
Sep 09 15:58:49.824862 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.824841    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557c79f68f-zmlws"]
Sep 09 15:58:49.828433 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:49.828412    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557c79f68f-zmlws"]
Sep 09 15:58:51.367178 ip-10-0-135-66 kubenswrapper[2578]: I0909 15:58:51.367104    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeeccc26-24e4-4e35-8379-4ae903a3fb49" path="/var/lib/kubelet/pods/aeeccc26-24e4-4e35-8379-4ae903a3fb49/volumes"
Sep 09 16:00:09.370319 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370289    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"]
Sep 09 16:00:09.370761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370555    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4711d0e-8c39-44f1-9234-e5299fa3da85" containerName="console"
Sep 09 16:00:09.370761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370566    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4711d0e-8c39-44f1-9234-e5299fa3da85" containerName="console"
Sep 09 16:00:09.370761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370576    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeeccc26-24e4-4e35-8379-4ae903a3fb49" containerName="console"
Sep 09 16:00:09.370761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370583    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeeccc26-24e4-4e35-8379-4ae903a3fb49" containerName="console"
Sep 09 16:00:09.370761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370627    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeeccc26-24e4-4e35-8379-4ae903a3fb49" containerName="console"
Sep 09 16:00:09.370761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.370636    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4711d0e-8c39-44f1-9234-e5299fa3da85" containerName="console"
Sep 09 16:00:09.373531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.373516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.375884 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.375864    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:00:09.376954 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.376940    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:00:09.377007 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.376978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wwx24\""
Sep 09 16:00:09.384306 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.384287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"]
Sep 09 16:00:09.533884 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.533848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.534079 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.533893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxbm\" (UniqueName: \"kubernetes.io/projected/cb909e71-766c-43e4-9043-fb69b7f2d899-kube-api-access-6gxbm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.534079 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.534015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.634803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.634723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.634803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.634769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxbm\" (UniqueName: \"kubernetes.io/projected/cb909e71-766c-43e4-9043-fb69b7f2d899-kube-api-access-6gxbm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.634982 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.634815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.635160 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.635136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.635219 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.635201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.643907 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.643884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxbm\" (UniqueName: \"kubernetes.io/projected/cb909e71-766c-43e4-9043-fb69b7f2d899-kube-api-access-6gxbm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.682760 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.682724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:09.950525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:09.950498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"]
Sep 09 16:00:09.952727 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:00:09.952700    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb909e71_766c_43e4_9043_fb69b7f2d899.slice/crio-1a35c84862489047bca71216f8ed96bd51b547605517d386ab0ab6d561f0eda7 WatchSource:0}: Error finding container 1a35c84862489047bca71216f8ed96bd51b547605517d386ab0ab6d561f0eda7: Status 404 returned error can't find the container with id 1a35c84862489047bca71216f8ed96bd51b547605517d386ab0ab6d561f0eda7
Sep 09 16:00:10.100792 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:10.100760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r" event={"ID":"cb909e71-766c-43e4-9043-fb69b7f2d899","Type":"ContainerStarted","Data":"1a35c84862489047bca71216f8ed96bd51b547605517d386ab0ab6d561f0eda7"}
Sep 09 16:00:17.137117 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:17.137083    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerID="91bf735e16e528695a0c0164f86512486b6beaa33b9615365f902127a04a7ea5" exitCode=0
Sep 09 16:00:17.137549 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:17.137170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r" event={"ID":"cb909e71-766c-43e4-9043-fb69b7f2d899","Type":"ContainerDied","Data":"91bf735e16e528695a0c0164f86512486b6beaa33b9615365f902127a04a7ea5"}
Sep 09 16:00:21.155455 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:21.155423    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerID="46c20ba60e74ea55c22697dd96268c7e322f85fef7c9c504282895c8d24f88cf" exitCode=0
Sep 09 16:00:21.155860 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:21.155498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r" event={"ID":"cb909e71-766c-43e4-9043-fb69b7f2d899","Type":"ContainerDied","Data":"46c20ba60e74ea55c22697dd96268c7e322f85fef7c9c504282895c8d24f88cf"}
Sep 09 16:00:28.185950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:28.185915    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerID="a97f86a729c59bf4c36cc4b9a378aaabb61d1c4146ae295d73880ed1dd8963fa" exitCode=0
Sep 09 16:00:28.186331 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:28.186000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r" event={"ID":"cb909e71-766c-43e4-9043-fb69b7f2d899","Type":"ContainerDied","Data":"a97f86a729c59bf4c36cc4b9a378aaabb61d1c4146ae295d73880ed1dd8963fa"}
Sep 09 16:00:29.304850 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.304828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:29.389155 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.389120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-util\") pod \"cb909e71-766c-43e4-9043-fb69b7f2d899\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") "
Sep 09 16:00:29.389314 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.389167    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-bundle\") pod \"cb909e71-766c-43e4-9043-fb69b7f2d899\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") "
Sep 09 16:00:29.389314 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.389198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gxbm\" (UniqueName: \"kubernetes.io/projected/cb909e71-766c-43e4-9043-fb69b7f2d899-kube-api-access-6gxbm\") pod \"cb909e71-766c-43e4-9043-fb69b7f2d899\" (UID: \"cb909e71-766c-43e4-9043-fb69b7f2d899\") "
Sep 09 16:00:29.389803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.389780    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-bundle" (OuterVolumeSpecName: "bundle") pod "cb909e71-766c-43e4-9043-fb69b7f2d899" (UID: "cb909e71-766c-43e4-9043-fb69b7f2d899"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:29.391361 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.391320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb909e71-766c-43e4-9043-fb69b7f2d899-kube-api-access-6gxbm" (OuterVolumeSpecName: "kube-api-access-6gxbm") pod "cb909e71-766c-43e4-9043-fb69b7f2d899" (UID: "cb909e71-766c-43e4-9043-fb69b7f2d899"). InnerVolumeSpecName "kube-api-access-6gxbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:29.393200 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.393177    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-util" (OuterVolumeSpecName: "util") pod "cb909e71-766c-43e4-9043-fb69b7f2d899" (UID: "cb909e71-766c-43e4-9043-fb69b7f2d899"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:29.490623 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.490586    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gxbm\" (UniqueName: \"kubernetes.io/projected/cb909e71-766c-43e4-9043-fb69b7f2d899-kube-api-access-6gxbm\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:00:29.490623 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.490619    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:00:29.490815 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:29.490635    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb909e71-766c-43e4-9043-fb69b7f2d899-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:00:30.195167 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:30.195131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r" event={"ID":"cb909e71-766c-43e4-9043-fb69b7f2d899","Type":"ContainerDied","Data":"1a35c84862489047bca71216f8ed96bd51b547605517d386ab0ab6d561f0eda7"}
Sep 09 16:00:30.195167 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:30.195166    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407zk8r"
Sep 09 16:00:30.195380 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:30.195185    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a35c84862489047bca71216f8ed96bd51b547605517d386ab0ab6d561f0eda7"
Sep 09 16:00:37.347325 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347288    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"]
Sep 09 16:00:37.347736 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347695    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="util"
Sep 09 16:00:37.347736 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347714    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="util"
Sep 09 16:00:37.347845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347746    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="extract"
Sep 09 16:00:37.347845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347755    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="extract"
Sep 09 16:00:37.347845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347766    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="pull"
Sep 09 16:00:37.347845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347772    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="pull"
Sep 09 16:00:37.347845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.347825    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb909e71-766c-43e4-9043-fb69b7f2d899" containerName="extract"
Sep 09 16:00:37.351296 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.351279    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.353824 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.353793    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 16:00:37.353824 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.353801    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:00:37.354021 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.353899    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m2hxx\""
Sep 09 16:00:37.361716 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.361695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"]
Sep 09 16:00:37.449959 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.449913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f3f0339-eb5e-4c30-be7d-4b3a4d32356d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzfmp\" (UID: \"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.450140 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.449979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l2zd\" (UniqueName: \"kubernetes.io/projected/9f3f0339-eb5e-4c30-be7d-4b3a4d32356d-kube-api-access-7l2zd\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzfmp\" (UID: \"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.551020 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.550969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l2zd\" (UniqueName: \"kubernetes.io/projected/9f3f0339-eb5e-4c30-be7d-4b3a4d32356d-kube-api-access-7l2zd\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzfmp\" (UID: \"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.551189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.551050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f3f0339-eb5e-4c30-be7d-4b3a4d32356d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzfmp\" (UID: \"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.551398 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.551383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f3f0339-eb5e-4c30-be7d-4b3a4d32356d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzfmp\" (UID: \"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.562671 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.562647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l2zd\" (UniqueName: \"kubernetes.io/projected/9f3f0339-eb5e-4c30-be7d-4b3a4d32356d-kube-api-access-7l2zd\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzfmp\" (UID: \"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.660102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.660014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"
Sep 09 16:00:37.936316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:37.936172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp"]
Sep 09 16:00:37.940763 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:00:37.940717    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3f0339_eb5e_4c30_be7d_4b3a4d32356d.slice/crio-1a9a4a110ea2b2c565c8d83dcf13982d708f2eaabd53d87612b2e13db2bec57d WatchSource:0}: Error finding container 1a9a4a110ea2b2c565c8d83dcf13982d708f2eaabd53d87612b2e13db2bec57d: Status 404 returned error can't find the container with id 1a9a4a110ea2b2c565c8d83dcf13982d708f2eaabd53d87612b2e13db2bec57d
Sep 09 16:00:38.226423 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:38.226392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp" event={"ID":"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d","Type":"ContainerStarted","Data":"1a9a4a110ea2b2c565c8d83dcf13982d708f2eaabd53d87612b2e13db2bec57d"}
Sep 09 16:00:42.245719 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.245682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp" event={"ID":"9f3f0339-eb5e-4c30-be7d-4b3a4d32356d","Type":"ContainerStarted","Data":"bc55bb747941ea9b5cd4776a9a9fb8a0c5361987c50cb9b7774c29f38dccb675"}
Sep 09 16:00:42.272578 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.272525    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzfmp" podStartSLOduration=1.815269411 podStartE2EDuration="5.272508142s" totalImagesPullingTime="3.457238731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:00:42.269920992 +0000 UTC m=+553.531050182" watchObservedRunningTime="2026-09-09 16:00:42.272508142 +0000 UTC m=+553.533637318"
Sep 09 16:00:42.788460 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.788425    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"]
Sep 09 16:00:42.790853 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.790832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.793532 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.793505    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:00:42.793532 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.793525    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wwx24\""
Sep 09 16:00:42.794520 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.794503    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:00:42.815597 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.815569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"]
Sep 09 16:00:42.895696 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.895660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.895696 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.895698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.895912 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.895729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jf55\" (UniqueName: \"kubernetes.io/projected/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-kube-api-access-5jf55\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.996782 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.996744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.996955 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.996787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.996955 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.996818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jf55\" (UniqueName: \"kubernetes.io/projected/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-kube-api-access-5jf55\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.997140 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.997121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:42.997196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:42.997179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:43.004956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:43.004923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jf55\" (UniqueName: \"kubernetes.io/projected/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-kube-api-access-5jf55\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:43.100179 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:43.100100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:43.370666 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:43.370591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"]
Sep 09 16:00:43.373142 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:00:43.373104    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9ee225_f0d2_44f3_b2b8_ed1aa78d1a17.slice/crio-2c4f9f4f1528d33383cd030f2815ccee1f61ce357ff37f6166f5aed43db10dce WatchSource:0}: Error finding container 2c4f9f4f1528d33383cd030f2815ccee1f61ce357ff37f6166f5aed43db10dce: Status 404 returned error can't find the container with id 2c4f9f4f1528d33383cd030f2815ccee1f61ce357ff37f6166f5aed43db10dce
Sep 09 16:00:44.260060 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.259976    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerID="69196a5989f94d27b966183142cbf620301f84450bdc3820fd18b8687ac9defb" exitCode=0
Sep 09 16:00:44.260210 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.260059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247" event={"ID":"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17","Type":"ContainerDied","Data":"69196a5989f94d27b966183142cbf620301f84450bdc3820fd18b8687ac9defb"}
Sep 09 16:00:44.260210 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.260137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247" event={"ID":"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17","Type":"ContainerStarted","Data":"2c4f9f4f1528d33383cd030f2815ccee1f61ce357ff37f6166f5aed43db10dce"}
Sep 09 16:00:44.755583 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.755544    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"]
Sep 09 16:00:44.757715 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.757697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:44.760332 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.760307    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 16:00:44.760504 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.760483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xpk6d\""
Sep 09 16:00:44.760564 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.760483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 16:00:44.767252 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.767230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"]
Sep 09 16:00:44.814685 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.814651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1528900-2732-44e0-aea6-f5307644ce4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h9xb2\" (UID: \"b1528900-2732-44e0-aea6-f5307644ce4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:44.814849 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.814706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfzjk\" (UniqueName: \"kubernetes.io/projected/b1528900-2732-44e0-aea6-f5307644ce4b-kube-api-access-lfzjk\") pod \"cert-manager-cainjector-559cdd8c87-h9xb2\" (UID: \"b1528900-2732-44e0-aea6-f5307644ce4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:44.915756 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.915717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1528900-2732-44e0-aea6-f5307644ce4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h9xb2\" (UID: \"b1528900-2732-44e0-aea6-f5307644ce4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:44.915945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.915797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfzjk\" (UniqueName: \"kubernetes.io/projected/b1528900-2732-44e0-aea6-f5307644ce4b-kube-api-access-lfzjk\") pod \"cert-manager-cainjector-559cdd8c87-h9xb2\" (UID: \"b1528900-2732-44e0-aea6-f5307644ce4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:44.923636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.923600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1528900-2732-44e0-aea6-f5307644ce4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h9xb2\" (UID: \"b1528900-2732-44e0-aea6-f5307644ce4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:44.923751 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:44.923701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfzjk\" (UniqueName: \"kubernetes.io/projected/b1528900-2732-44e0-aea6-f5307644ce4b-kube-api-access-lfzjk\") pod \"cert-manager-cainjector-559cdd8c87-h9xb2\" (UID: \"b1528900-2732-44e0-aea6-f5307644ce4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:45.084061 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:45.083968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"
Sep 09 16:00:45.355396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:45.355044    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2"]
Sep 09 16:00:45.357794 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:00:45.357760    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1528900_2732_44e0_aea6_f5307644ce4b.slice/crio-6a6192758ffa21b15f21f31fb7691a04259b979e0d4381684ab84e3a4a395e60 WatchSource:0}: Error finding container 6a6192758ffa21b15f21f31fb7691a04259b979e0d4381684ab84e3a4a395e60: Status 404 returned error can't find the container with id 6a6192758ffa21b15f21f31fb7691a04259b979e0d4381684ab84e3a4a395e60
Sep 09 16:00:46.270397 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:46.270359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2" event={"ID":"b1528900-2732-44e0-aea6-f5307644ce4b","Type":"ContainerStarted","Data":"6a6192758ffa21b15f21f31fb7691a04259b979e0d4381684ab84e3a4a395e60"}
Sep 09 16:00:47.281329 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:47.281275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247" event={"ID":"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17","Type":"ContainerStarted","Data":"6c6077355a6879b4b5bc0327326576e21a364d1f6c407c674c0f0fb1cdfa35fb"}
Sep 09 16:00:48.288407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:48.288366    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerID="6c6077355a6879b4b5bc0327326576e21a364d1f6c407c674c0f0fb1cdfa35fb" exitCode=0
Sep 09 16:00:48.288407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:48.288398    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerID="d3ac76e6d5263bab88421f0cadff0b94552b81c68508a8319e1607951eb46cc1" exitCode=0
Sep 09 16:00:48.288945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:48.288450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247" event={"ID":"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17","Type":"ContainerDied","Data":"6c6077355a6879b4b5bc0327326576e21a364d1f6c407c674c0f0fb1cdfa35fb"}
Sep 09 16:00:48.288945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:48.288506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247" event={"ID":"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17","Type":"ContainerDied","Data":"d3ac76e6d5263bab88421f0cadff0b94552b81c68508a8319e1607951eb46cc1"}
Sep 09 16:00:49.295421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.295376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2" event={"ID":"b1528900-2732-44e0-aea6-f5307644ce4b","Type":"ContainerStarted","Data":"71f996761a228879ee48861ab7236f30102de25d6eadefedadefce6ee44adaf3"}
Sep 09 16:00:49.311951 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.311847    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h9xb2" podStartSLOduration=1.609468766 podStartE2EDuration="5.311829671s" totalImagesPullingTime="3.702360905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:00:49.310433642 +0000 UTC m=+560.571562821" watchObservedRunningTime="2026-09-09 16:00:49.311829671 +0000 UTC m=+560.572958845"
Sep 09 16:00:49.448699 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.448666    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:49.563289 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.563201    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-util\") pod \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") "
Sep 09 16:00:49.563445 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.563344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jf55\" (UniqueName: \"kubernetes.io/projected/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-kube-api-access-5jf55\") pod \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") "
Sep 09 16:00:49.563445 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.563402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-bundle\") pod \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\" (UID: \"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17\") "
Sep 09 16:00:49.563789 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.563763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-bundle" (OuterVolumeSpecName: "bundle") pod "8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" (UID: "8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:49.565372 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.565334    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-kube-api-access-5jf55" (OuterVolumeSpecName: "kube-api-access-5jf55") pod "8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" (UID: "8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17"). InnerVolumeSpecName "kube-api-access-5jf55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:00:49.570506 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.570481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-util" (OuterVolumeSpecName: "util") pod "8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" (UID: "8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:00:49.664124 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.664087    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jf55\" (UniqueName: \"kubernetes.io/projected/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-kube-api-access-5jf55\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:00:49.664124 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.664118    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:00:49.664124 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:49.664127    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:00:50.301107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:50.301077    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247"
Sep 09 16:00:50.301107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:50.301089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnw247" event={"ID":"8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17","Type":"ContainerDied","Data":"2c4f9f4f1528d33383cd030f2815ccee1f61ce357ff37f6166f5aed43db10dce"}
Sep 09 16:00:50.301584 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:00:50.301139    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c4f9f4f1528d33383cd030f2815ccee1f61ce357ff37f6166f5aed43db10dce"
Sep 09 16:01:02.035155 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035120    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"]
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035425    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="util"
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035436    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="util"
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035444    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="extract"
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035449    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="extract"
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035463    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="pull"
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035469    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="pull"
Sep 09 16:01:02.035621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.035517    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c9ee225-f0d2-44f3-b2b8-ed1aa78d1a17" containerName="extract"
Sep 09 16:01:02.039649 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.039631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.042378 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.042336    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:01:02.042640 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.042624    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:01:02.043661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.043628    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wwx24\""
Sep 09 16:01:02.046898 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.046877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"]
Sep 09 16:01:02.161699 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.161644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.161891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.161734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5jzg\" (UniqueName: \"kubernetes.io/projected/0769ed55-7437-464c-8a4e-03bc29d5cd2a-kube-api-access-j5jzg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.161891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.161768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.262485 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.262430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.262680 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.262516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5jzg\" (UniqueName: \"kubernetes.io/projected/0769ed55-7437-464c-8a4e-03bc29d5cd2a-kube-api-access-j5jzg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.262680 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.262548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.262839 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.262820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.262880 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.262855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.271307 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.271274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5jzg\" (UniqueName: \"kubernetes.io/projected/0769ed55-7437-464c-8a4e-03bc29d5cd2a-kube-api-access-j5jzg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.349410 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.349288    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:02.617197 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.617076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"]
Sep 09 16:01:02.621163 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:02.621137    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0769ed55_7437_464c_8a4e_03bc29d5cd2a.slice/crio-0752e45fbb6649be6e79e591ef811da8be28d06ac833458dce76405837d71326 WatchSource:0}: Error finding container 0752e45fbb6649be6e79e591ef811da8be28d06ac833458dce76405837d71326: Status 404 returned error can't find the container with id 0752e45fbb6649be6e79e591ef811da8be28d06ac833458dce76405837d71326
Sep 09 16:01:02.895754 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.895677    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xk6zm"]
Sep 09 16:01:02.897942 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.897926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:02.900509 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.900487    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cn2rm\""
Sep 09 16:01:02.909673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.909641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xk6zm"]
Sep 09 16:01:02.968759 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.968720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22f58b08-bf35-466a-be83-e9765d9edc62-bound-sa-token\") pod \"cert-manager-55b4d954d5-xk6zm\" (UID: \"22f58b08-bf35-466a-be83-e9765d9edc62\") " pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:02.968759 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:02.968769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg4qz\" (UniqueName: \"kubernetes.io/projected/22f58b08-bf35-466a-be83-e9765d9edc62-kube-api-access-pg4qz\") pod \"cert-manager-55b4d954d5-xk6zm\" (UID: \"22f58b08-bf35-466a-be83-e9765d9edc62\") " pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:03.070058 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.070027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg4qz\" (UniqueName: \"kubernetes.io/projected/22f58b08-bf35-466a-be83-e9765d9edc62-kube-api-access-pg4qz\") pod \"cert-manager-55b4d954d5-xk6zm\" (UID: \"22f58b08-bf35-466a-be83-e9765d9edc62\") " pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:03.070448 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.070115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22f58b08-bf35-466a-be83-e9765d9edc62-bound-sa-token\") pod \"cert-manager-55b4d954d5-xk6zm\" (UID: \"22f58b08-bf35-466a-be83-e9765d9edc62\") " pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:03.078142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.078113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22f58b08-bf35-466a-be83-e9765d9edc62-bound-sa-token\") pod \"cert-manager-55b4d954d5-xk6zm\" (UID: \"22f58b08-bf35-466a-be83-e9765d9edc62\") " pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:03.078292 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.078271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg4qz\" (UniqueName: \"kubernetes.io/projected/22f58b08-bf35-466a-be83-e9765d9edc62-kube-api-access-pg4qz\") pod \"cert-manager-55b4d954d5-xk6zm\" (UID: \"22f58b08-bf35-466a-be83-e9765d9edc62\") " pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:03.207048 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.207006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xk6zm"
Sep 09 16:01:03.358700 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.358659    2578 generic.go:356] "Generic (PLEG): container finished" podID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerID="2fe0954bb01cfd1bf35d078914519cb9988daed866c095c9ddc74cf92e0f9255" exitCode=0
Sep 09 16:01:03.358878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.358745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc" event={"ID":"0769ed55-7437-464c-8a4e-03bc29d5cd2a","Type":"ContainerDied","Data":"2fe0954bb01cfd1bf35d078914519cb9988daed866c095c9ddc74cf92e0f9255"}
Sep 09 16:01:03.358878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.358820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc" event={"ID":"0769ed55-7437-464c-8a4e-03bc29d5cd2a","Type":"ContainerStarted","Data":"0752e45fbb6649be6e79e591ef811da8be28d06ac833458dce76405837d71326"}
Sep 09 16:01:03.476346 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:03.476319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xk6zm"]
Sep 09 16:01:03.478847 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:03.478808    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22f58b08_bf35_466a_be83_e9765d9edc62.slice/crio-2c527d83b4d1c7856391d5a009562393d999db7651004309bbfe1fc55d506bc7 WatchSource:0}: Error finding container 2c527d83b4d1c7856391d5a009562393d999db7651004309bbfe1fc55d506bc7: Status 404 returned error can't find the container with id 2c527d83b4d1c7856391d5a009562393d999db7651004309bbfe1fc55d506bc7
Sep 09 16:01:04.365502 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:04.365464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xk6zm" event={"ID":"22f58b08-bf35-466a-be83-e9765d9edc62","Type":"ContainerStarted","Data":"9fc44256bf43833e45005b2e33d2fad34b5963511a74d4ecbaa0318b1d1aab96"}
Sep 09 16:01:04.365878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:04.365512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xk6zm" event={"ID":"22f58b08-bf35-466a-be83-e9765d9edc62","Type":"ContainerStarted","Data":"2c527d83b4d1c7856391d5a009562393d999db7651004309bbfe1fc55d506bc7"}
Sep 09 16:01:04.381812 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:04.381756    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xk6zm" podStartSLOduration=2.381735737 podStartE2EDuration="2.381735737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:01:04.380850976 +0000 UTC m=+575.641980149" watchObservedRunningTime="2026-09-09 16:01:04.381735737 +0000 UTC m=+575.642864912"
Sep 09 16:01:06.375828 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:06.375796    2578 generic.go:356] "Generic (PLEG): container finished" podID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerID="8c542e9a99fa39e82ad2f581118b8cc8153a7f04a68f81d07e55fca5647cccee" exitCode=0
Sep 09 16:01:06.376217 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:06.375850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc" event={"ID":"0769ed55-7437-464c-8a4e-03bc29d5cd2a","Type":"ContainerDied","Data":"8c542e9a99fa39e82ad2f581118b8cc8153a7f04a68f81d07e55fca5647cccee"}
Sep 09 16:01:07.382927 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:07.382892    2578 generic.go:356] "Generic (PLEG): container finished" podID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerID="32fd2ed73added8b8d17ff2a0eb9e2fd3f5fddee40526ea197f61a2820630e06" exitCode=0
Sep 09 16:01:07.383319 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:07.382963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc" event={"ID":"0769ed55-7437-464c-8a4e-03bc29d5cd2a","Type":"ContainerDied","Data":"32fd2ed73added8b8d17ff2a0eb9e2fd3f5fddee40526ea197f61a2820630e06"}
Sep 09 16:01:08.515403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.515376    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:08.620083 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.620049    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-bundle\") pod \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") "
Sep 09 16:01:08.620239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.620105    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-util\") pod \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") "
Sep 09 16:01:08.620239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.620131    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5jzg\" (UniqueName: \"kubernetes.io/projected/0769ed55-7437-464c-8a4e-03bc29d5cd2a-kube-api-access-j5jzg\") pod \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\" (UID: \"0769ed55-7437-464c-8a4e-03bc29d5cd2a\") "
Sep 09 16:01:08.620772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.620743    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-bundle" (OuterVolumeSpecName: "bundle") pod "0769ed55-7437-464c-8a4e-03bc29d5cd2a" (UID: "0769ed55-7437-464c-8a4e-03bc29d5cd2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:08.622332 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.622295    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0769ed55-7437-464c-8a4e-03bc29d5cd2a-kube-api-access-j5jzg" (OuterVolumeSpecName: "kube-api-access-j5jzg") pod "0769ed55-7437-464c-8a4e-03bc29d5cd2a" (UID: "0769ed55-7437-464c-8a4e-03bc29d5cd2a"). InnerVolumeSpecName "kube-api-access-j5jzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:01:08.627104 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.627071    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-util" (OuterVolumeSpecName: "util") pod "0769ed55-7437-464c-8a4e-03bc29d5cd2a" (UID: "0769ed55-7437-464c-8a4e-03bc29d5cd2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:08.721145 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.721110    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:08.721145 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.721138    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0769ed55-7437-464c-8a4e-03bc29d5cd2a-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:08.721145 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:08.721148    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5jzg\" (UniqueName: \"kubernetes.io/projected/0769ed55-7437-464c-8a4e-03bc29d5cd2a-kube-api-access-j5jzg\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:09.393899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:09.393862    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc" event={"ID":"0769ed55-7437-464c-8a4e-03bc29d5cd2a","Type":"ContainerDied","Data":"0752e45fbb6649be6e79e591ef811da8be28d06ac833458dce76405837d71326"}
Sep 09 16:01:09.393899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:09.393886    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzfxnc"
Sep 09 16:01:09.394101 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:09.393914    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0752e45fbb6649be6e79e591ef811da8be28d06ac833458dce76405837d71326"
Sep 09 16:01:18.278140 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278101    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559fb8446f-vxg4x"]
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278410    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="extract"
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278422    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="extract"
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278443    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="util"
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278449    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="util"
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278456    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="pull"
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278461    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="pull"
Sep 09 16:01:18.278548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.278513    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0769ed55-7437-464c-8a4e-03bc29d5cd2a" containerName="extract"
Sep 09 16:01:18.281210 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.281189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304415 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-service-ca\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304415 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-trusted-ca-bundle\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304645 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-oauth-config\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304645 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-oauth-serving-cert\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304645 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-serving-cert\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304770 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-config\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.304770 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.304672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx2qp\" (UniqueName: \"kubernetes.io/projected/ad2dd456-a215-4bdc-a7cb-050bef655bea-kube-api-access-zx2qp\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.314752 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.314714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559fb8446f-vxg4x"]
Sep 09 16:01:18.405413 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-oauth-serving-cert\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.405413 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-serving-cert\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.405634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-config\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.405753 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx2qp\" (UniqueName: \"kubernetes.io/projected/ad2dd456-a215-4bdc-a7cb-050bef655bea-kube-api-access-zx2qp\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.405815 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-service-ca\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.405869 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-trusted-ca-bundle\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.405918 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.405897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-oauth-config\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.406223 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.406200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-oauth-serving-cert\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.406313 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.406206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-config\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.406382 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.406333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-service-ca\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.406723 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.406700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad2dd456-a215-4bdc-a7cb-050bef655bea-trusted-ca-bundle\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.408051 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.408028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-serving-cert\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.408142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.408098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad2dd456-a215-4bdc-a7cb-050bef655bea-console-oauth-config\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.415193 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.415173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx2qp\" (UniqueName: \"kubernetes.io/projected/ad2dd456-a215-4bdc-a7cb-050bef655bea-kube-api-access-zx2qp\") pod \"console-559fb8446f-vxg4x\" (UID: \"ad2dd456-a215-4bdc-a7cb-050bef655bea\") " pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.590239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.590156    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:18.865123 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:18.865100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559fb8446f-vxg4x"]
Sep 09 16:01:18.867813 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:18.867790    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2dd456_a215_4bdc_a7cb_050bef655bea.slice/crio-cb4d4f34a1059b2d5e8db3f8814d305469772a8dc8a27dac1243e1d72d705cbc WatchSource:0}: Error finding container cb4d4f34a1059b2d5e8db3f8814d305469772a8dc8a27dac1243e1d72d705cbc: Status 404 returned error can't find the container with id cb4d4f34a1059b2d5e8db3f8814d305469772a8dc8a27dac1243e1d72d705cbc
Sep 09 16:01:19.165064 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.164977    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"]
Sep 09 16:01:19.167654 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.167634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.171581 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.171557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 16:01:19.172236 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.172206    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 16:01:19.172308 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.172291    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 16:01:19.172622 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.172606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 16:01:19.177632 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.177608    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jndt2\""
Sep 09 16:01:19.211787 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.211752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-manifests\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.211787 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.211790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-tmp\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.212001 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.211820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.212001 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.211913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rzh\" (UniqueName: \"kubernetes.io/projected/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-kube-api-access-95rzh\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.212107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.212052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.212516 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.212489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"]
Sep 09 16:01:19.246951 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.246913    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"]
Sep 09 16:01:19.249368 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.249336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.252207 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.252182    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wwx24\""
Sep 09 16:01:19.252344 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.252213    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:01:19.252344 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.252230    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:01:19.261422 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.261390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"]
Sep 09 16:01:19.313431 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqw9r\" (UniqueName: \"kubernetes.io/projected/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-kube-api-access-vqw9r\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.313431 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.313980 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.313980 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-manifests\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.313980 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-tmp\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.313980 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.313980 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95rzh\" (UniqueName: \"kubernetes.io/projected/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-kube-api-access-95rzh\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.313980 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.314186 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.313983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-manifests\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.315848 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.315826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-tmp\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.316618 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.316594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.316721 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.316594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.321740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.321711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rzh\" (UniqueName: \"kubernetes.io/projected/1176bd3e-a4ec-4d82-8638-6e58c3aaab69-kube-api-access-95rzh\") pod \"opendatahub-operator-controller-manager-b4ccd886c-s8d7q\" (UID: \"1176bd3e-a4ec-4d82-8638-6e58c3aaab69\") " pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.414082 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.414049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqw9r\" (UniqueName: \"kubernetes.io/projected/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-kube-api-access-vqw9r\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.414271 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.414098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.414271 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.414223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.414564 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.414530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.414677 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.414574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.422249 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.422185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqw9r\" (UniqueName: \"kubernetes.io/projected/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-kube-api-access-vqw9r\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.439178 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.439146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559fb8446f-vxg4x" event={"ID":"ad2dd456-a215-4bdc-a7cb-050bef655bea","Type":"ContainerStarted","Data":"9a760071bc916205ee89b3f2947c68fcccd4c6ab661c5f46c444d3c1a015e9ce"}
Sep 09 16:01:19.439341 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.439195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559fb8446f-vxg4x" event={"ID":"ad2dd456-a215-4bdc-a7cb-050bef655bea","Type":"ContainerStarted","Data":"cb4d4f34a1059b2d5e8db3f8814d305469772a8dc8a27dac1243e1d72d705cbc"}
Sep 09 16:01:19.456536 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.456486    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559fb8446f-vxg4x" podStartSLOduration=1.45646944 podStartE2EDuration="1.45646944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:01:19.454891995 +0000 UTC m=+590.716021175" watchObservedRunningTime="2026-09-09 16:01:19.45646944 +0000 UTC m=+590.717598616"
Sep 09 16:01:19.478554 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.478515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:19.558867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.558833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:19.756779 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.756580    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"]
Sep 09 16:01:19.759396 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:19.759367    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1176bd3e_a4ec_4d82_8638_6e58c3aaab69.slice/crio-8a4ec4400875b47ea2bbc0fcfe97f8365ee0dfe7aa81666bd88d1ecb38580de3 WatchSource:0}: Error finding container 8a4ec4400875b47ea2bbc0fcfe97f8365ee0dfe7aa81666bd88d1ecb38580de3: Status 404 returned error can't find the container with id 8a4ec4400875b47ea2bbc0fcfe97f8365ee0dfe7aa81666bd88d1ecb38580de3
Sep 09 16:01:19.835665 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:19.835612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"]
Sep 09 16:01:19.838260 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:19.838235    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a09711_d2e5_4b7c_9af4_f8049b0bca4d.slice/crio-8cc8b6c2d5f8640a95aceaa79a3ec18932cabc0d1315f3c1002e1bf989c79def WatchSource:0}: Error finding container 8cc8b6c2d5f8640a95aceaa79a3ec18932cabc0d1315f3c1002e1bf989c79def: Status 404 returned error can't find the container with id 8cc8b6c2d5f8640a95aceaa79a3ec18932cabc0d1315f3c1002e1bf989c79def
Sep 09 16:01:20.445818 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:20.445780    2578 generic.go:356] "Generic (PLEG): container finished" podID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerID="ef14b1e75fdcdd32e199cf972ce495036775e5914f210c5936a535a02f1590c1" exitCode=0
Sep 09 16:01:20.446230 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:20.445873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt" event={"ID":"81a09711-d2e5-4b7c-9af4-f8049b0bca4d","Type":"ContainerDied","Data":"ef14b1e75fdcdd32e199cf972ce495036775e5914f210c5936a535a02f1590c1"}
Sep 09 16:01:20.446230 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:20.445931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt" event={"ID":"81a09711-d2e5-4b7c-9af4-f8049b0bca4d","Type":"ContainerStarted","Data":"8cc8b6c2d5f8640a95aceaa79a3ec18932cabc0d1315f3c1002e1bf989c79def"}
Sep 09 16:01:20.447249 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:20.447227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q" event={"ID":"1176bd3e-a4ec-4d82-8638-6e58c3aaab69","Type":"ContainerStarted","Data":"8a4ec4400875b47ea2bbc0fcfe97f8365ee0dfe7aa81666bd88d1ecb38580de3"}
Sep 09 16:01:25.474950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:25.474917    2578 generic.go:356] "Generic (PLEG): container finished" podID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerID="7abd539fdf887428dbcf7bf47395e8efd1e20ff435a553e378cc61d943be61f1" exitCode=0
Sep 09 16:01:25.475391 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:25.475001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt" event={"ID":"81a09711-d2e5-4b7c-9af4-f8049b0bca4d","Type":"ContainerDied","Data":"7abd539fdf887428dbcf7bf47395e8efd1e20ff435a553e378cc61d943be61f1"}
Sep 09 16:01:25.476939 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:25.476912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q" event={"ID":"1176bd3e-a4ec-4d82-8638-6e58c3aaab69","Type":"ContainerStarted","Data":"399087ffcefc6b9152282cb714117d8aaad133dfe551c6e42e36df011ff55cd2"}
Sep 09 16:01:26.483712 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:26.483671    2578 generic.go:356] "Generic (PLEG): container finished" podID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerID="417cc738d43f5afab696d6d79d435eab5cea6d6b541fd3d507607f68b3421988" exitCode=0
Sep 09 16:01:26.484163 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:26.483719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt" event={"ID":"81a09711-d2e5-4b7c-9af4-f8049b0bca4d","Type":"ContainerDied","Data":"417cc738d43f5afab696d6d79d435eab5cea6d6b541fd3d507607f68b3421988"}
Sep 09 16:01:26.485525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:26.485501    2578 generic.go:356] "Generic (PLEG): container finished" podID="1176bd3e-a4ec-4d82-8638-6e58c3aaab69" containerID="399087ffcefc6b9152282cb714117d8aaad133dfe551c6e42e36df011ff55cd2" exitCode=0
Sep 09 16:01:26.485641 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:26.485578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q" event={"ID":"1176bd3e-a4ec-4d82-8638-6e58c3aaab69","Type":"ContainerDied","Data":"399087ffcefc6b9152282cb714117d8aaad133dfe551c6e42e36df011ff55cd2"}
Sep 09 16:01:27.492845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.492811    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q" event={"ID":"1176bd3e-a4ec-4d82-8638-6e58c3aaab69","Type":"ContainerStarted","Data":"e9c8f64a501e40b7725a4dcc799379f0aadaef2ca5fe19582d09458c7fc1cb45"}
Sep 09 16:01:27.493217 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.492978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:27.519095 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.519042    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q" podStartSLOduration=1.859698722 podStartE2EDuration="8.519022553s" totalImagesPullingTime="5.531378707s" totalInitContainerRuntime="1.127945124s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:01:27.51811716 +0000 UTC m=+598.779246339" watchObservedRunningTime="2026-09-09 16:01:27.519022553 +0000 UTC m=+598.780151728"
Sep 09 16:01:27.617500 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.617476    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:27.690208 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.690173    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-bundle\") pod \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") "
Sep 09 16:01:27.690407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.690231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqw9r\" (UniqueName: \"kubernetes.io/projected/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-kube-api-access-vqw9r\") pod \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") "
Sep 09 16:01:27.690407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.690286    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-util\") pod \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\" (UID: \"81a09711-d2e5-4b7c-9af4-f8049b0bca4d\") "
Sep 09 16:01:27.691025 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.691001    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-bundle" (OuterVolumeSpecName: "bundle") pod "81a09711-d2e5-4b7c-9af4-f8049b0bca4d" (UID: "81a09711-d2e5-4b7c-9af4-f8049b0bca4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:27.692474 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.692446    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-kube-api-access-vqw9r" (OuterVolumeSpecName: "kube-api-access-vqw9r") pod "81a09711-d2e5-4b7c-9af4-f8049b0bca4d" (UID: "81a09711-d2e5-4b7c-9af4-f8049b0bca4d"). InnerVolumeSpecName "kube-api-access-vqw9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:01:27.694445 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.694407    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-util" (OuterVolumeSpecName: "util") pod "81a09711-d2e5-4b7c-9af4-f8049b0bca4d" (UID: "81a09711-d2e5-4b7c-9af4-f8049b0bca4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:01:27.791620 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.791531    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:27.791620 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.791565    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqw9r\" (UniqueName: \"kubernetes.io/projected/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-kube-api-access-vqw9r\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:27.791620 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:27.791574    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a09711-d2e5-4b7c-9af4-f8049b0bca4d-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:28.499701 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:28.499674    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt"
Sep 09 16:01:28.500189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:28.499701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fqwjt" event={"ID":"81a09711-d2e5-4b7c-9af4-f8049b0bca4d","Type":"ContainerDied","Data":"8cc8b6c2d5f8640a95aceaa79a3ec18932cabc0d1315f3c1002e1bf989c79def"}
Sep 09 16:01:28.500189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:28.499744    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cc8b6c2d5f8640a95aceaa79a3ec18932cabc0d1315f3c1002e1bf989c79def"
Sep 09 16:01:28.590434 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:28.590399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:28.590573 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:28.590491    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:28.595346 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:28.595319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:29.508104 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:29.508077    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559fb8446f-vxg4x"
Sep 09 16:01:29.574528 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:29.574486    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f765c548b-kcb4d"]
Sep 09 16:01:38.501885 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:38.501853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4ccd886c-s8d7q"
Sep 09 16:01:42.297360 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297318    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-747b697884-hfp2m"]
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297616    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="util"
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297627    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="util"
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297640    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="extract"
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297645    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="extract"
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297652    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="pull"
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297658    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="pull"
Sep 09 16:01:42.297743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.297715    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a09711-d2e5-4b7c-9af4-f8049b0bca4d" containerName="extract"
Sep 09 16:01:42.306743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.306721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.309996 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.309971    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 16:01:42.310130 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.310092    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-477md\""
Sep 09 16:01:42.310231 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.310215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 16:01:42.315499 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.315478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-747b697884-hfp2m"]
Sep 09 16:01:42.424220 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.424191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzckr\" (UniqueName: \"kubernetes.io/projected/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-kube-api-access-wzckr\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.424428 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.424255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tls-certs\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.424428 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.424388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tmp\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.525190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.525150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzckr\" (UniqueName: \"kubernetes.io/projected/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-kube-api-access-wzckr\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.525421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.525220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tls-certs\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.525421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.525299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tmp\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.525421 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:01:42.525400    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 09 16:01:42.525593 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:01:42.525486    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tls-certs podName:00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82 nodeName:}" failed. No retries permitted until 2026-09-09 16:01:43.025463413 +0000 UTC m=+614.286592568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tls-certs") pod "kube-auth-proxy-747b697884-hfp2m" (UID: "00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82") : secret "kube-auth-proxy-tls" not found
Sep 09 16:01:42.527526 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.527499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tmp\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:42.536387 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:42.536340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzckr\" (UniqueName: \"kubernetes.io/projected/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-kube-api-access-wzckr\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:43.030669 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:43.030635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tls-certs\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:43.033234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:43.033208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82-tls-certs\") pod \"kube-auth-proxy-747b697884-hfp2m\" (UID: \"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82\") " pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:43.217192 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:43.217161    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m"
Sep 09 16:01:43.487716 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:43.487689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-747b697884-hfp2m"]
Sep 09 16:01:43.489655 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:43.489627    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00541c1b_2d78_4f15_9ec8_f7ea6d9d8d82.slice/crio-4555afbf650d699b3e7e360205f837bda99a6aa2d01620367401d4e159d835c7 WatchSource:0}: Error finding container 4555afbf650d699b3e7e360205f837bda99a6aa2d01620367401d4e159d835c7: Status 404 returned error can't find the container with id 4555afbf650d699b3e7e360205f837bda99a6aa2d01620367401d4e159d835c7
Sep 09 16:01:43.491585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:43.491571    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:01:43.569637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:43.569598    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m" event={"ID":"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82","Type":"ContainerStarted","Data":"4555afbf650d699b3e7e360205f837bda99a6aa2d01620367401d4e159d835c7"}
Sep 09 16:01:48.599606 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:48.599566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m" event={"ID":"00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82","Type":"ContainerStarted","Data":"c6e24703604fa5017996d622d774f499839d3745d7172cae08e6cf5ecd73470f"}
Sep 09 16:01:48.621383 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:48.621310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-747b697884-hfp2m" podStartSLOduration=2.315471052 podStartE2EDuration="6.62128969s" totalImagesPullingTime="4.305818638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:01:48.619462657 +0000 UTC m=+619.880591824" watchObservedRunningTime="2026-09-09 16:01:48.62128969 +0000 UTC m=+619.882418866"
Sep 09 16:01:51.355431 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.355333    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5c6rx"]
Sep 09 16:01:51.357738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.357721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:51.360401 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.360381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 16:01:51.360541 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.360443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-db447\""
Sep 09 16:01:51.375285 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.375259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5c6rx"]
Sep 09 16:01:51.505143 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.505109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98ht\" (UniqueName: \"kubernetes.io/projected/efc75cd1-f882-4d22-81b2-47ee45c19d06-kube-api-access-x98ht\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:51.505143 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.505150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc75cd1-f882-4d22-81b2-47ee45c19d06-cert\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:51.605979 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.605876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98ht\" (UniqueName: \"kubernetes.io/projected/efc75cd1-f882-4d22-81b2-47ee45c19d06-kube-api-access-x98ht\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:51.605979 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.605929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc75cd1-f882-4d22-81b2-47ee45c19d06-cert\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:51.606186 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:01:51.606081    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 16:01:51.606186 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:01:51.606148    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc75cd1-f882-4d22-81b2-47ee45c19d06-cert podName:efc75cd1-f882-4d22-81b2-47ee45c19d06 nodeName:}" failed. No retries permitted until 2026-09-09 16:01:52.106131928 +0000 UTC m=+623.367261082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc75cd1-f882-4d22-81b2-47ee45c19d06-cert") pod "odh-model-controller-7998c67dc4-5c6rx" (UID: "efc75cd1-f882-4d22-81b2-47ee45c19d06") : secret "odh-model-controller-webhook-cert" not found
Sep 09 16:01:51.615250 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:51.615215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98ht\" (UniqueName: \"kubernetes.io/projected/efc75cd1-f882-4d22-81b2-47ee45c19d06-kube-api-access-x98ht\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:52.110012 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:52.109965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc75cd1-f882-4d22-81b2-47ee45c19d06-cert\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:52.112633 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:52.112607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc75cd1-f882-4d22-81b2-47ee45c19d06-cert\") pod \"odh-model-controller-7998c67dc4-5c6rx\" (UID: \"efc75cd1-f882-4d22-81b2-47ee45c19d06\") " pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:52.273427 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:52.273387    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:52.545117 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:52.545091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5c6rx"]
Sep 09 16:01:52.547653 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:52.547623    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc75cd1_f882_4d22_81b2_47ee45c19d06.slice/crio-b151142df8092dfdacda66a409a8b138571a45d02bef7a20dcc167484d558ed1 WatchSource:0}: Error finding container b151142df8092dfdacda66a409a8b138571a45d02bef7a20dcc167484d558ed1: Status 404 returned error can't find the container with id b151142df8092dfdacda66a409a8b138571a45d02bef7a20dcc167484d558ed1
Sep 09 16:01:52.618566 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:52.618530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx" event={"ID":"efc75cd1-f882-4d22-81b2-47ee45c19d06","Type":"ContainerStarted","Data":"b151142df8092dfdacda66a409a8b138571a45d02bef7a20dcc167484d558ed1"}
Sep 09 16:01:54.594366 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:54.594302    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f765c548b-kcb4d" podUID="54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" containerName="console" containerID="cri-o://f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd" gracePeriod=15
Sep 09 16:01:54.855457 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:54.855387    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 16:01:55.036183 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036145    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-config\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036210    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-service-ca\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-oauth-serving-cert\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-serving-cert\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-oauth-config\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lwhf\" (UniqueName: \"kubernetes.io/projected/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-kube-api-access-8lwhf\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-trusted-ca-bundle\") pod \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\" (UID: \"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf\") "
Sep 09 16:01:55.036723 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-config" (OuterVolumeSpecName: "console-config") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:01:55.036723 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036677    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:01:55.036990 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:01:55.037101 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.036986    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-service-ca" (OuterVolumeSpecName: "service-ca") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:01:55.038822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.038796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:01:55.039117 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.039082    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-kube-api-access-8lwhf" (OuterVolumeSpecName: "kube-api-access-8lwhf") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "kube-api-access-8lwhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:01:55.039209 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.039122    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" (UID: "54951b39-4e73-4cda-9fa7-7e7b16ea2ebf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.137912    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lwhf\" (UniqueName: \"kubernetes.io/projected/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-kube-api-access-8lwhf\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.137954    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-trusted-ca-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.137966    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.137977    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.137990    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-oauth-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.138004    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-serving-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.138015 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.138016    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf-console-oauth-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:01:55.634279 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.634241    2578 generic.go:356] "Generic (PLEG): container finished" podID="54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" containerID="f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd" exitCode=0
Sep 09 16:01:55.634711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.634291    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f765c548b-kcb4d"
Sep 09 16:01:55.634711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.634325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f765c548b-kcb4d" event={"ID":"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf","Type":"ContainerDied","Data":"f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd"}
Sep 09 16:01:55.634711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.634393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f765c548b-kcb4d" event={"ID":"54951b39-4e73-4cda-9fa7-7e7b16ea2ebf","Type":"ContainerDied","Data":"824c94ef0b8e40fcec9174c89908d4d23adf5b494710a186add90782bff59db0"}
Sep 09 16:01:55.634711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.634414    2578 scope.go:117] "RemoveContainer" containerID="f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd"
Sep 09 16:01:55.643406 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.643385    2578 scope.go:117] "RemoveContainer" containerID="f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd"
Sep 09 16:01:55.643687 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:01:55.643668    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd\": container with ID starting with f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd not found: ID does not exist" containerID="f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd"
Sep 09 16:01:55.643740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.643695    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd"} err="failed to get container status \"f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd\": rpc error: code = NotFound desc = could not find container \"f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd\": container with ID starting with f7e03751fb5cc91ed25edee2bfcee6f1dfa5d9a0e3e288c9d525cd1dcefbb5cd not found: ID does not exist"
Sep 09 16:01:55.651585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.651555    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f765c548b-kcb4d"]
Sep 09 16:01:55.655198 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:55.655176    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f765c548b-kcb4d"]
Sep 09 16:01:57.367337 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:57.367301    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" path="/var/lib/kubelet/pods/54951b39-4e73-4cda-9fa7-7e7b16ea2ebf/volumes"
Sep 09 16:01:57.647892 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:57.647799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx" event={"ID":"efc75cd1-f882-4d22-81b2-47ee45c19d06","Type":"ContainerStarted","Data":"d88bb56839cead0149f29b69db1976c7afbb3300b3ed0e5962020ca013d028e7"}
Sep 09 16:01:57.648062 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:57.647939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:01:57.665182 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:57.665117    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx" podStartSLOduration=1.950534381 podStartE2EDuration="6.665097311s" totalImagesPullingTime="4.71456293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:01:57.664769935 +0000 UTC m=+628.925899112" watchObservedRunningTime="2026-09-09 16:01:57.665097311 +0000 UTC m=+628.926226489"
Sep 09 16:01:59.201259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.201210    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"]
Sep 09 16:01:59.201787 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.201698    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" containerName="console"
Sep 09 16:01:59.201787 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.201716    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" containerName="console"
Sep 09 16:01:59.201904 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.201797    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54951b39-4e73-4cda-9fa7-7e7b16ea2ebf" containerName="console"
Sep 09 16:01:59.203982 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.203958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.208745 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.208716    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 16:01:59.208904 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.208718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 16:01:59.209041 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.209026    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xctbn\""
Sep 09 16:01:59.209297 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.209281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 16:01:59.209396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.209294    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 16:01:59.225426 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.225388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"]
Sep 09 16:01:59.278380 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b19b88eb-885f-45bc-a0f1-8d1c983026b8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.278563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.278563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.278563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.278563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.278709 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.278709 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.278633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6gz8\" (UniqueName: \"kubernetes.io/projected/b19b88eb-885f-45bc-a0f1-8d1c983026b8-kube-api-access-s6gz8\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.379877 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.379838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.379877 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.379880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6gz8\" (UniqueName: \"kubernetes.io/projected/b19b88eb-885f-45bc-a0f1-8d1c983026b8-kube-api-access-s6gz8\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.380132 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.379929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b19b88eb-885f-45bc-a0f1-8d1c983026b8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.380132 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.379951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.380132 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.379975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.380132 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.380006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.380132 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.380038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.380910 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.380878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.382413 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.382384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b19b88eb-885f-45bc-a0f1-8d1c983026b8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.382513 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.382427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.382593 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.382572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.382632 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.382588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.399869 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.399833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6gz8\" (UniqueName: \"kubernetes.io/projected/b19b88eb-885f-45bc-a0f1-8d1c983026b8-kube-api-access-s6gz8\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.417794 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.417756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b19b88eb-885f-45bc-a0f1-8d1c983026b8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dd6l7\" (UID: \"b19b88eb-885f-45bc-a0f1-8d1c983026b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.514227 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.514132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:01:59.797656 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:01:59.797574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"]
Sep 09 16:01:59.800872 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:01:59.800841    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19b88eb_885f_45bc_a0f1_8d1c983026b8.slice/crio-ffe0d708168aa6a5711f8bc4573422731e83f8704d29dfb7b0e9b87bbddf739f WatchSource:0}: Error finding container ffe0d708168aa6a5711f8bc4573422731e83f8704d29dfb7b0e9b87bbddf739f: Status 404 returned error can't find the container with id ffe0d708168aa6a5711f8bc4573422731e83f8704d29dfb7b0e9b87bbddf739f
Sep 09 16:02:00.665237 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:00.665188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7" event={"ID":"b19b88eb-885f-45bc-a0f1-8d1c983026b8","Type":"ContainerStarted","Data":"ffe0d708168aa6a5711f8bc4573422731e83f8704d29dfb7b0e9b87bbddf739f"}
Sep 09 16:02:02.369364 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:02.369312    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:02:02.369652 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:02.369406    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:02:02.677380 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:02.677257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7" event={"ID":"b19b88eb-885f-45bc-a0f1-8d1c983026b8","Type":"ContainerStarted","Data":"e91b75f3f2e6b06b40aecab89d62684613076c12669ceabf0820baef503f5963"}
Sep 09 16:02:02.677380 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:02.677338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:02:02.721532 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:02.721454    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7" podStartSLOduration=1.155390553 podStartE2EDuration="3.721431227s" totalImagesPullingTime="2.566040674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:02:02.716857075 +0000 UTC m=+633.977986243" watchObservedRunningTime="2026-09-09 16:02:02.721431227 +0000 UTC m=+633.982560405"
Sep 09 16:02:03.684425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:03.684392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7"
Sep 09 16:02:08.654872 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:08.654837    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5c6rx"
Sep 09 16:02:56.359860 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.359823    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"]
Sep 09 16:02:56.365445 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.363926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.366945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.366916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:02:56.367942 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.367923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wwx24\""
Sep 09 16:02:56.368003 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.367944    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:02:56.372295 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.372271    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"]
Sep 09 16:02:56.456382 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.456344    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"]
Sep 09 16:02:56.458949 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.458933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.467718 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.467697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"]
Sep 09 16:02:56.467857 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.467837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.467911 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.467879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.467969 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.467954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8jk\" (UniqueName: \"kubernetes.io/projected/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-kube-api-access-8r8jk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.552962 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.552932    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"]
Sep 09 16:02:56.555335 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.555320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.564643 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.564622    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"]
Sep 09 16:02:56.568590 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.568704 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57knr\" (UniqueName: \"kubernetes.io/projected/dbc98719-3188-4b3d-8ebd-810695d9ddf7-kube-api-access-57knr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.568704 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.568704 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.568816 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8jk\" (UniqueName: \"kubernetes.io/projected/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-kube-api-access-8r8jk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.568855 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.568965 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.568952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.569034 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.569013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.576847 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.576828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8jk\" (UniqueName: \"kubernetes.io/projected/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-kube-api-access-8r8jk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.663807 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.663749    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"]
Sep 09 16:02:56.666100 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.666085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.669282 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtctn\" (UniqueName: \"kubernetes.io/projected/a1144da1-66e6-4b6c-a735-48660adde298-kube-api-access-wtctn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.669400 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.669400 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.669496 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.669496 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57knr\" (UniqueName: \"kubernetes.io/projected/dbc98719-3188-4b3d-8ebd-810695d9ddf7-kube-api-access-57knr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.669595 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.669732 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.669852 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.669827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.674284 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.674266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:02:56.679829 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.679810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"]
Sep 09 16:02:56.681955 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.681936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57knr\" (UniqueName: \"kubernetes.io/projected/dbc98719-3188-4b3d-8ebd-810695d9ddf7-kube-api-access-57knr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.768596 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.768566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:02:56.770343 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57f5\" (UniqueName: \"kubernetes.io/projected/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-kube-api-access-z57f5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.770438 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtctn\" (UniqueName: \"kubernetes.io/projected/a1144da1-66e6-4b6c-a735-48660adde298-kube-api-access-wtctn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.770438 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.770438 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.770580 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.770580 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.770811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.770864 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.770808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.779277 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.779257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtctn\" (UniqueName: \"kubernetes.io/projected/a1144da1-66e6-4b6c-a735-48660adde298-kube-api-access-wtctn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.863828 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.863804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:02:56.871678 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.871651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57f5\" (UniqueName: \"kubernetes.io/projected/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-kube-api-access-z57f5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.871780 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.871694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.871780 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.871732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.872132 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.872107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.872184 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.872107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.880645 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.880615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57f5\" (UniqueName: \"kubernetes.io/projected/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-kube-api-access-z57f5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:56.946341 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.946263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"]
Sep 09 16:02:56.948927 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:02:56.948903    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec2edb4_f78f_4ece_846e_e0d3bc42464c.slice/crio-a4c0828c0515996ff3966d650ddf10832241a4b49a3cb39f2c34322081a4c32a WatchSource:0}: Error finding container a4c0828c0515996ff3966d650ddf10832241a4b49a3cb39f2c34322081a4c32a: Status 404 returned error can't find the container with id a4c0828c0515996ff3966d650ddf10832241a4b49a3cb39f2c34322081a4c32a
Sep 09 16:02:56.974918 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:56.974898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:02:57.038424 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.038395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"]
Sep 09 16:02:57.039275 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:02:57.039243    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc98719_3188_4b3d_8ebd_810695d9ddf7.slice/crio-3c83a6b7c5e70f67a987baa6a225b899712fef882d9d6a020c99541812831c83 WatchSource:0}: Error finding container 3c83a6b7c5e70f67a987baa6a225b899712fef882d9d6a020c99541812831c83: Status 404 returned error can't find the container with id 3c83a6b7c5e70f67a987baa6a225b899712fef882d9d6a020c99541812831c83
Sep 09 16:02:57.132020 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.131994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"]
Sep 09 16:02:57.135663 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:02:57.135641    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1144da1_66e6_4b6c_a735_48660adde298.slice/crio-80d33aa4c78fd911c5b919c45157f11a9b752a5de65d1b23f7f1d6d2c33a4add WatchSource:0}: Error finding container 80d33aa4c78fd911c5b919c45157f11a9b752a5de65d1b23f7f1d6d2c33a4add: Status 404 returned error can't find the container with id 80d33aa4c78fd911c5b919c45157f11a9b752a5de65d1b23f7f1d6d2c33a4add
Sep 09 16:02:57.247843 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.247818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"]
Sep 09 16:02:57.247973 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:02:57.247951    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a91e7b_3102_401b_b3ea_a2eac9d487a9.slice/crio-190d9b1724f956db5780be9b6d1672f31051964c2f2148c3b2bdb2bbf99a8dda WatchSource:0}: Error finding container 190d9b1724f956db5780be9b6d1672f31051964c2f2148c3b2bdb2bbf99a8dda: Status 404 returned error can't find the container with id 190d9b1724f956db5780be9b6d1672f31051964c2f2148c3b2bdb2bbf99a8dda
Sep 09 16:02:57.940543 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.940510    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerID="3fbfafb69fac5b648594d2741ffde44be996388945178bca3a5b4121460ef64e" exitCode=0
Sep 09 16:02:57.940968 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.940599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95" event={"ID":"1ec2edb4-f78f-4ece-846e-e0d3bc42464c","Type":"ContainerDied","Data":"3fbfafb69fac5b648594d2741ffde44be996388945178bca3a5b4121460ef64e"}
Sep 09 16:02:57.940968 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.940660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95" event={"ID":"1ec2edb4-f78f-4ece-846e-e0d3bc42464c","Type":"ContainerStarted","Data":"a4c0828c0515996ff3966d650ddf10832241a4b49a3cb39f2c34322081a4c32a"}
Sep 09 16:02:57.942196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.942074    2578 generic.go:356] "Generic (PLEG): container finished" podID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerID="3a0a0c6d87da5abf046516ec6f8fdb285cfac7dd92c2e3978025991c26274633" exitCode=0
Sep 09 16:02:57.942196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.942159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg" event={"ID":"c6a91e7b-3102-401b-b3ea-a2eac9d487a9","Type":"ContainerDied","Data":"3a0a0c6d87da5abf046516ec6f8fdb285cfac7dd92c2e3978025991c26274633"}
Sep 09 16:02:57.942196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.942195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg" event={"ID":"c6a91e7b-3102-401b-b3ea-a2eac9d487a9","Type":"ContainerStarted","Data":"190d9b1724f956db5780be9b6d1672f31051964c2f2148c3b2bdb2bbf99a8dda"}
Sep 09 16:02:57.943698 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.943681    2578 generic.go:356] "Generic (PLEG): container finished" podID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerID="b66de11cd8f16167957c5c902bb21ac517446763761d0ab43d557322c7dace99" exitCode=0
Sep 09 16:02:57.943784 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.943754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc" event={"ID":"dbc98719-3188-4b3d-8ebd-810695d9ddf7","Type":"ContainerDied","Data":"b66de11cd8f16167957c5c902bb21ac517446763761d0ab43d557322c7dace99"}
Sep 09 16:02:57.943842 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.943794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc" event={"ID":"dbc98719-3188-4b3d-8ebd-810695d9ddf7","Type":"ContainerStarted","Data":"3c83a6b7c5e70f67a987baa6a225b899712fef882d9d6a020c99541812831c83"}
Sep 09 16:02:57.945328 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.945309    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1144da1-66e6-4b6c-a735-48660adde298" containerID="3531921fba56cf61d0247ff0149467765961d90d4bcdd82bb07b66c866a1cc4c" exitCode=0
Sep 09 16:02:57.945421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.945343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr" event={"ID":"a1144da1-66e6-4b6c-a735-48660adde298","Type":"ContainerDied","Data":"3531921fba56cf61d0247ff0149467765961d90d4bcdd82bb07b66c866a1cc4c"}
Sep 09 16:02:57.945421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:57.945412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr" event={"ID":"a1144da1-66e6-4b6c-a735-48660adde298","Type":"ContainerStarted","Data":"80d33aa4c78fd911c5b919c45157f11a9b752a5de65d1b23f7f1d6d2c33a4add"}
Sep 09 16:02:58.953175 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:58.953148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc" event={"ID":"dbc98719-3188-4b3d-8ebd-810695d9ddf7","Type":"ContainerStarted","Data":"0ac2a25843d1175ff1c2fa718c3d384101d6d6b7688675e2cb995f14751b9f29"}
Sep 09 16:02:59.960385 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:59.960336    2578 generic.go:356] "Generic (PLEG): container finished" podID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerID="0ac2a25843d1175ff1c2fa718c3d384101d6d6b7688675e2cb995f14751b9f29" exitCode=0
Sep 09 16:02:59.960868 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:59.960428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc" event={"ID":"dbc98719-3188-4b3d-8ebd-810695d9ddf7","Type":"ContainerDied","Data":"0ac2a25843d1175ff1c2fa718c3d384101d6d6b7688675e2cb995f14751b9f29"}
Sep 09 16:02:59.962494 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:59.962462    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1144da1-66e6-4b6c-a735-48660adde298" containerID="45cbe71cea1323158da7e84092ef4cabff3834b46890902e63a7b4b136ca04ad" exitCode=0
Sep 09 16:02:59.962593 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:59.962494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr" event={"ID":"a1144da1-66e6-4b6c-a735-48660adde298","Type":"ContainerDied","Data":"45cbe71cea1323158da7e84092ef4cabff3834b46890902e63a7b4b136ca04ad"}
Sep 09 16:02:59.964620 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:59.964602    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerID="b87c7bf363eed8d424c0d9e9ccf5eb7fa61bdc4847c7067991339bda93ef5203" exitCode=0
Sep 09 16:02:59.964699 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:02:59.964655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95" event={"ID":"1ec2edb4-f78f-4ece-846e-e0d3bc42464c","Type":"ContainerDied","Data":"b87c7bf363eed8d424c0d9e9ccf5eb7fa61bdc4847c7067991339bda93ef5203"}
Sep 09 16:03:00.972440 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:00.972409    2578 generic.go:356] "Generic (PLEG): container finished" podID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerID="25b0d79b0bbd94decdaa417ee618cc3b271de727efcbc20604650a92d20b6541" exitCode=0
Sep 09 16:03:00.972815 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:00.972445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc" event={"ID":"dbc98719-3188-4b3d-8ebd-810695d9ddf7","Type":"ContainerDied","Data":"25b0d79b0bbd94decdaa417ee618cc3b271de727efcbc20604650a92d20b6541"}
Sep 09 16:03:00.974723 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:00.974698    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1144da1-66e6-4b6c-a735-48660adde298" containerID="a8db71776fc2102043f5dd2e2601872afd4734690f8162bf11a55899e0b228ae" exitCode=0
Sep 09 16:03:00.974835 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:00.974778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr" event={"ID":"a1144da1-66e6-4b6c-a735-48660adde298","Type":"ContainerDied","Data":"a8db71776fc2102043f5dd2e2601872afd4734690f8162bf11a55899e0b228ae"}
Sep 09 16:03:00.976942 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:00.976920    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerID="8c1c3e91ff6bd3ed2a930fdce84f64e343a83a9c4724a770fdd6cec26f7b20a3" exitCode=0
Sep 09 16:03:00.977044 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:00.976953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95" event={"ID":"1ec2edb4-f78f-4ece-846e-e0d3bc42464c","Type":"ContainerDied","Data":"8c1c3e91ff6bd3ed2a930fdce84f64e343a83a9c4724a770fdd6cec26f7b20a3"}
Sep 09 16:03:02.116562 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.116539    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:03:02.163425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.163405    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:03:02.165575 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.165560    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:03:02.217597 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-bundle\") pod \"a1144da1-66e6-4b6c-a735-48660adde298\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") "
Sep 09 16:03:02.217717 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-util\") pod \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") "
Sep 09 16:03:02.217717 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217647    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtctn\" (UniqueName: \"kubernetes.io/projected/a1144da1-66e6-4b6c-a735-48660adde298-kube-api-access-wtctn\") pod \"a1144da1-66e6-4b6c-a735-48660adde298\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") "
Sep 09 16:03:02.217717 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-bundle\") pod \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") "
Sep 09 16:03:02.217717 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r8jk\" (UniqueName: \"kubernetes.io/projected/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-kube-api-access-8r8jk\") pod \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") "
Sep 09 16:03:02.217924 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217754    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57knr\" (UniqueName: \"kubernetes.io/projected/dbc98719-3188-4b3d-8ebd-810695d9ddf7-kube-api-access-57knr\") pod \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\" (UID: \"dbc98719-3188-4b3d-8ebd-810695d9ddf7\") "
Sep 09 16:03:02.217924 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-util\") pod \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") "
Sep 09 16:03:02.217924 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-util\") pod \"a1144da1-66e6-4b6c-a735-48660adde298\" (UID: \"a1144da1-66e6-4b6c-a735-48660adde298\") "
Sep 09 16:03:02.217924 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.217855    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-bundle\") pod \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\" (UID: \"1ec2edb4-f78f-4ece-846e-e0d3bc42464c\") "
Sep 09 16:03:02.218566 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.218533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-bundle" (OuterVolumeSpecName: "bundle") pod "a1144da1-66e6-4b6c-a735-48660adde298" (UID: "a1144da1-66e6-4b6c-a735-48660adde298"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:02.218675 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.218565    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-bundle" (OuterVolumeSpecName: "bundle") pod "1ec2edb4-f78f-4ece-846e-e0d3bc42464c" (UID: "1ec2edb4-f78f-4ece-846e-e0d3bc42464c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:02.218746 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.218676    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-bundle" (OuterVolumeSpecName: "bundle") pod "dbc98719-3188-4b3d-8ebd-810695d9ddf7" (UID: "dbc98719-3188-4b3d-8ebd-810695d9ddf7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:02.219908 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.219877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-kube-api-access-8r8jk" (OuterVolumeSpecName: "kube-api-access-8r8jk") pod "1ec2edb4-f78f-4ece-846e-e0d3bc42464c" (UID: "1ec2edb4-f78f-4ece-846e-e0d3bc42464c"). InnerVolumeSpecName "kube-api-access-8r8jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:02.220031 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.220002    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1144da1-66e6-4b6c-a735-48660adde298-kube-api-access-wtctn" (OuterVolumeSpecName: "kube-api-access-wtctn") pod "a1144da1-66e6-4b6c-a735-48660adde298" (UID: "a1144da1-66e6-4b6c-a735-48660adde298"). InnerVolumeSpecName "kube-api-access-wtctn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:02.220802 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.220782    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc98719-3188-4b3d-8ebd-810695d9ddf7-kube-api-access-57knr" (OuterVolumeSpecName: "kube-api-access-57knr") pod "dbc98719-3188-4b3d-8ebd-810695d9ddf7" (UID: "dbc98719-3188-4b3d-8ebd-810695d9ddf7"). InnerVolumeSpecName "kube-api-access-57knr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:02.224075 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.224046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-util" (OuterVolumeSpecName: "util") pod "dbc98719-3188-4b3d-8ebd-810695d9ddf7" (UID: "dbc98719-3188-4b3d-8ebd-810695d9ddf7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:02.224324 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.224301    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-util" (OuterVolumeSpecName: "util") pod "a1144da1-66e6-4b6c-a735-48660adde298" (UID: "a1144da1-66e6-4b6c-a735-48660adde298"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:02.246276 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.246223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-util" (OuterVolumeSpecName: "util") pod "1ec2edb4-f78f-4ece-846e-e0d3bc42464c" (UID: "1ec2edb4-f78f-4ece-846e-e0d3bc42464c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:02.318706 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318680    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318706 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318706    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtctn\" (UniqueName: \"kubernetes.io/projected/a1144da1-66e6-4b6c-a735-48660adde298-kube-api-access-wtctn\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318721    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc98719-3188-4b3d-8ebd-810695d9ddf7-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318733    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r8jk\" (UniqueName: \"kubernetes.io/projected/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-kube-api-access-8r8jk\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318745    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57knr\" (UniqueName: \"kubernetes.io/projected/dbc98719-3188-4b3d-8ebd-810695d9ddf7-kube-api-access-57knr\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318758    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318770    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318781    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec2edb4-f78f-4ece-846e-e0d3bc42464c-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.318845 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.318791    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1144da1-66e6-4b6c-a735-48660adde298-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:02.988970 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.988934    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95"
Sep 09 16:03:02.989137 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.988937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6c5z95" event={"ID":"1ec2edb4-f78f-4ece-846e-e0d3bc42464c","Type":"ContainerDied","Data":"a4c0828c0515996ff3966d650ddf10832241a4b49a3cb39f2c34322081a4c32a"}
Sep 09 16:03:02.989137 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.989066    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4c0828c0515996ff3966d650ddf10832241a4b49a3cb39f2c34322081a4c32a"
Sep 09 16:03:02.990939 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.990916    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc"
Sep 09 16:03:02.991076 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.990917    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d74tgzc" event={"ID":"dbc98719-3188-4b3d-8ebd-810695d9ddf7","Type":"ContainerDied","Data":"3c83a6b7c5e70f67a987baa6a225b899712fef882d9d6a020c99541812831c83"}
Sep 09 16:03:02.991076 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.991035    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c83a6b7c5e70f67a987baa6a225b899712fef882d9d6a020c99541812831c83"
Sep 09 16:03:02.993000 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.992982    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr"
Sep 09 16:03:02.993107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.993013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ac6mbr" event={"ID":"a1144da1-66e6-4b6c-a735-48660adde298","Type":"ContainerDied","Data":"80d33aa4c78fd911c5b919c45157f11a9b752a5de65d1b23f7f1d6d2c33a4add"}
Sep 09 16:03:02.993107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:02.993043    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80d33aa4c78fd911c5b919c45157f11a9b752a5de65d1b23f7f1d6d2c33a4add"
Sep 09 16:03:18.067705 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:18.067672    2578 generic.go:356] "Generic (PLEG): container finished" podID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerID="983959d9c872feca107f3346c4dda553f163a760058a754b03b37a97fe852fc9" exitCode=0
Sep 09 16:03:18.068045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:18.067734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg" event={"ID":"c6a91e7b-3102-401b-b3ea-a2eac9d487a9","Type":"ContainerDied","Data":"983959d9c872feca107f3346c4dda553f163a760058a754b03b37a97fe852fc9"}
Sep 09 16:03:19.074238 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:19.074205    2578 generic.go:356] "Generic (PLEG): container finished" podID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerID="7a0d81322a1e69d414fa7433473145f356160770e46a0981055e514d7bad1a68" exitCode=0
Sep 09 16:03:19.074634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:19.074285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg" event={"ID":"c6a91e7b-3102-401b-b3ea-a2eac9d487a9","Type":"ContainerDied","Data":"7a0d81322a1e69d414fa7433473145f356160770e46a0981055e514d7bad1a68"}
Sep 09 16:03:20.205889 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.205866    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:03:20.263926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.263894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z57f5\" (UniqueName: \"kubernetes.io/projected/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-kube-api-access-z57f5\") pod \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") "
Sep 09 16:03:20.263926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.263934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-util\") pod \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") "
Sep 09 16:03:20.264127 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.263977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-bundle\") pod \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\" (UID: \"c6a91e7b-3102-401b-b3ea-a2eac9d487a9\") "
Sep 09 16:03:20.264527 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.264492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-bundle" (OuterVolumeSpecName: "bundle") pod "c6a91e7b-3102-401b-b3ea-a2eac9d487a9" (UID: "c6a91e7b-3102-401b-b3ea-a2eac9d487a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:20.265936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.265913    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-kube-api-access-z57f5" (OuterVolumeSpecName: "kube-api-access-z57f5") pod "c6a91e7b-3102-401b-b3ea-a2eac9d487a9" (UID: "c6a91e7b-3102-401b-b3ea-a2eac9d487a9"). InnerVolumeSpecName "kube-api-access-z57f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:20.268504 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.268483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-util" (OuterVolumeSpecName: "util") pod "c6a91e7b-3102-401b-b3ea-a2eac9d487a9" (UID: "c6a91e7b-3102-401b-b3ea-a2eac9d487a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:20.364738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.364623    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:20.364738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.364668    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z57f5\" (UniqueName: \"kubernetes.io/projected/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-kube-api-access-z57f5\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:20.364738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:20.364686    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a91e7b-3102-401b-b3ea-a2eac9d487a9-util\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:21.086327 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:21.086258    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg"
Sep 09 16:03:21.086503 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:21.086259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8mvhg" event={"ID":"c6a91e7b-3102-401b-b3ea-a2eac9d487a9","Type":"ContainerDied","Data":"190d9b1724f956db5780be9b6d1672f31051964c2f2148c3b2bdb2bbf99a8dda"}
Sep 09 16:03:21.086503 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:21.086424    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="190d9b1724f956db5780be9b6d1672f31051964c2f2148c3b2bdb2bbf99a8dda"
Sep 09 16:03:29.494677 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494647    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"]
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494948    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="pull"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494959    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="pull"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494968    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="pull"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494973    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="pull"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494984    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="pull"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494989    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="pull"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.494995    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="extract"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495001    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="extract"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495009    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="util"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495014    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="util"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495020    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="util"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495025    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="util"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495030    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="util"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495035    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="util"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495042    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="extract"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495049    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="extract"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495058    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="extract"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495066    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="extract"
Sep 09 16:03:29.495065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495073    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="extract"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495081    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="extract"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495088    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="util"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495093    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="util"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495104    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="pull"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495109    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="pull"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495165    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec2edb4-f78f-4ece-846e-e0d3bc42464c" containerName="extract"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495172    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc98719-3188-4b3d-8ebd-810695d9ddf7" containerName="extract"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495178    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1144da1-66e6-4b6c-a735-48660adde298" containerName="extract"
Sep 09 16:03:29.495636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.495186    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a91e7b-3102-401b-b3ea-a2eac9d487a9" containerName="extract"
Sep 09 16:03:29.498077 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.498061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:29.500719 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.500691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9szt9\""
Sep 09 16:03:29.501860 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.501840    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 16:03:29.501981 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.501891    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 16:03:29.509077 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.509053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"]
Sep 09 16:03:29.646340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.646306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jw22\" (UniqueName: \"kubernetes.io/projected/06823eb6-7def-44ba-8240-6aff15d336fa-kube-api-access-2jw22\") pod \"limitador-operator-controller-manager-74495c69f8-lcn9c\" (UID: \"06823eb6-7def-44ba-8240-6aff15d336fa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:29.747788 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.747710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jw22\" (UniqueName: \"kubernetes.io/projected/06823eb6-7def-44ba-8240-6aff15d336fa-kube-api-access-2jw22\") pod \"limitador-operator-controller-manager-74495c69f8-lcn9c\" (UID: \"06823eb6-7def-44ba-8240-6aff15d336fa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:29.758430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.758403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jw22\" (UniqueName: \"kubernetes.io/projected/06823eb6-7def-44ba-8240-6aff15d336fa-kube-api-access-2jw22\") pod \"limitador-operator-controller-manager-74495c69f8-lcn9c\" (UID: \"06823eb6-7def-44ba-8240-6aff15d336fa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:29.808423 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:29.808396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:30.084344 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:30.084315    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"]
Sep 09 16:03:30.086029 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:03:30.085993    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06823eb6_7def_44ba_8240_6aff15d336fa.slice/crio-1a959b8a35d81e19e0c68aa599396a228ededf0786aa3124bd90e04664400492 WatchSource:0}: Error finding container 1a959b8a35d81e19e0c68aa599396a228ededf0786aa3124bd90e04664400492: Status 404 returned error can't find the container with id 1a959b8a35d81e19e0c68aa599396a228ededf0786aa3124bd90e04664400492
Sep 09 16:03:30.133716 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:30.133683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c" event={"ID":"06823eb6-7def-44ba-8240-6aff15d336fa","Type":"ContainerStarted","Data":"1a959b8a35d81e19e0c68aa599396a228ededf0786aa3124bd90e04664400492"}
Sep 09 16:03:33.151490 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:33.151453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c" event={"ID":"06823eb6-7def-44ba-8240-6aff15d336fa","Type":"ContainerStarted","Data":"0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7"}
Sep 09 16:03:33.151928 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:33.151531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:33.179277 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:33.179232    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c" podStartSLOduration=1.7540191200000002 podStartE2EDuration="4.179216562s" totalImagesPullingTime="2.425197442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:03:33.178529376 +0000 UTC m=+724.439658553" watchObservedRunningTime="2026-09-09 16:03:33.179216562 +0000 UTC m=+724.440345738"
Sep 09 16:03:35.873561 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:35.873527    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"]
Sep 09 16:03:35.876923 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:35.876895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:35.880259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:35.880237    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lgrv5\""
Sep 09 16:03:35.893501 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:35.893479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"]
Sep 09 16:03:35.998641 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:35.998615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l2hh\" (UniqueName: \"kubernetes.io/projected/7d440753-6f0c-408d-a9c3-d078bb0468a9-kube-api-access-6l2hh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:35.998751 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:35.998654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d440753-6f0c-408d-a9c3-d078bb0468a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:36.099405 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:36.099375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l2hh\" (UniqueName: \"kubernetes.io/projected/7d440753-6f0c-408d-a9c3-d078bb0468a9-kube-api-access-6l2hh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:36.099524 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:36.099409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d440753-6f0c-408d-a9c3-d078bb0468a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:36.099760 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:36.099742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d440753-6f0c-408d-a9c3-d078bb0468a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:36.107960 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:36.107934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l2hh\" (UniqueName: \"kubernetes.io/projected/7d440753-6f0c-408d-a9c3-d078bb0468a9-kube-api-access-6l2hh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:36.186792 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:36.186736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:36.471527 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:36.471503    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"]
Sep 09 16:03:36.474122 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:03:36.474096    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d440753_6f0c_408d_a9c3_d078bb0468a9.slice/crio-8e18f5889c73b40152852f9de572a32623c3b1aeb65da3c634a6f354c4b95f78 WatchSource:0}: Error finding container 8e18f5889c73b40152852f9de572a32623c3b1aeb65da3c634a6f354c4b95f78: Status 404 returned error can't find the container with id 8e18f5889c73b40152852f9de572a32623c3b1aeb65da3c634a6f354c4b95f78
Sep 09 16:03:37.176743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:37.176706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b" event={"ID":"7d440753-6f0c-408d-a9c3-d078bb0468a9","Type":"ContainerStarted","Data":"8e18f5889c73b40152852f9de572a32623c3b1aeb65da3c634a6f354c4b95f78"}
Sep 09 16:03:41.202601 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:41.202559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b" event={"ID":"7d440753-6f0c-408d-a9c3-d078bb0468a9","Type":"ContainerStarted","Data":"cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8"}
Sep 09 16:03:41.202994 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:41.202794    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:41.223077 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:41.223033    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b" podStartSLOduration=2.2653595 podStartE2EDuration="6.223020038s" totalImagesPullingTime="3.957660538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:03:41.221716847 +0000 UTC m=+732.482846024" watchObservedRunningTime="2026-09-09 16:03:41.223020038 +0000 UTC m=+732.484149217"
Sep 09 16:03:44.161800 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:44.161769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:52.209786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:52.209672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:53.566596 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.566557    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"]
Sep 09 16:03:53.572595 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.572572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.581775 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.581747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"]
Sep 09 16:03:53.638234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.638189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee0a740-99d1-4d53-89db-19f6231aa876-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.638441 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.638310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-882d5\" (UniqueName: \"kubernetes.io/projected/4ee0a740-99d1-4d53-89db-19f6231aa876-kube-api-access-882d5\") pod \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.739630 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.739586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee0a740-99d1-4d53-89db-19f6231aa876-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.739812 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.739764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-882d5\" (UniqueName: \"kubernetes.io/projected/4ee0a740-99d1-4d53-89db-19f6231aa876-kube-api-access-882d5\") pod \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.739984 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.739965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee0a740-99d1-4d53-89db-19f6231aa876-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.748526 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.748502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-882d5\" (UniqueName: \"kubernetes.io/projected/4ee0a740-99d1-4d53-89db-19f6231aa876-kube-api-access-882d5\") pod \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:53.882924 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:53.882823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:54.162961 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.162934    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"]
Sep 09 16:03:54.165124 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:03:54.165098    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee0a740_99d1_4d53_89db_19f6231aa876.slice/crio-fe84d5b70d68f2625e6e602e74455875d6deed218205cfd623639ba259096034 WatchSource:0}: Error finding container fe84d5b70d68f2625e6e602e74455875d6deed218205cfd623639ba259096034: Status 404 returned error can't find the container with id fe84d5b70d68f2625e6e602e74455875d6deed218205cfd623639ba259096034
Sep 09 16:03:54.275931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.275885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j" event={"ID":"4ee0a740-99d1-4d53-89db-19f6231aa876","Type":"ContainerStarted","Data":"8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7"}
Sep 09 16:03:54.276116 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.275964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j" event={"ID":"4ee0a740-99d1-4d53-89db-19f6231aa876","Type":"ContainerStarted","Data":"fe84d5b70d68f2625e6e602e74455875d6deed218205cfd623639ba259096034"}
Sep 09 16:03:54.276116 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.275995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:54.295789 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.295723    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j" podStartSLOduration=1.29570338 podStartE2EDuration="1.29570338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:03:54.294390868 +0000 UTC m=+745.555520034" watchObservedRunningTime="2026-09-09 16:03:54.29570338 +0000 UTC m=+745.556832557"
Sep 09 16:03:54.348364 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.348306    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"]
Sep 09 16:03:54.359440 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.359404    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"]
Sep 09 16:03:54.373530 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.373500    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"]
Sep 09 16:03:54.373856 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.373842    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" containerName="manager"
Sep 09 16:03:54.373856 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.373857    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" containerName="manager"
Sep 09 16:03:54.373978 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.373963    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" containerName="manager"
Sep 09 16:03:54.377044 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.377018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.390430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.390406    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"]
Sep 09 16:03:54.390606 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.390573    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" containerName="manager" containerID="cri-o://cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8" gracePeriod=2
Sep 09 16:03:54.393943 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.393924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"]
Sep 09 16:03:54.401023 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.400999    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"]
Sep 09 16:03:54.414214 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.414152    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"]
Sep 09 16:03:54.414365 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.414330    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" containerName="manager" containerID="cri-o://0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7" gracePeriod=2
Sep 09 16:03:54.423737 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.423702    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:54.433928 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.433900    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"]
Sep 09 16:03:54.445559 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.445537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce59b60b-6653-4148-9d80-e6cfa536a68c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-lw2m7\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.445630 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.445569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx8rt\" (UniqueName: \"kubernetes.io/projected/ce59b60b-6653-4148-9d80-e6cfa536a68c-kube-api-access-kx8rt\") pod \"kuadrant-operator-controller-manager-5f685c496f-lw2m7\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.455912 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.455882    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"]
Sep 09 16:03:54.456231 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.456219    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" containerName="manager"
Sep 09 16:03:54.456288 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.456233    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" containerName="manager"
Sep 09 16:03:54.456288 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.456256    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" containerName="manager"
Sep 09 16:03:54.456288 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.456261    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" containerName="manager"
Sep 09 16:03:54.456408 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.456310    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" containerName="manager"
Sep 09 16:03:54.456408 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.456323    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" containerName="manager"
Sep 09 16:03:54.459276 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.459245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:03:54.473993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.473960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"]
Sep 09 16:03:54.512697 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.512655    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:54.516294 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.516269    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcn9c\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:54.548104 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.548052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwtk\" (UniqueName: \"kubernetes.io/projected/3ea1abdf-c837-4769-869f-b39a2a8e573b-kube-api-access-6dwtk\") pod \"limitador-operator-controller-manager-74495c69f8-lpgsg\" (UID: \"3ea1abdf-c837-4769-869f-b39a2a8e573b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:03:54.548377 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.548174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce59b60b-6653-4148-9d80-e6cfa536a68c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-lw2m7\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.548377 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.548209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8rt\" (UniqueName: \"kubernetes.io/projected/ce59b60b-6653-4148-9d80-e6cfa536a68c-kube-api-access-kx8rt\") pod \"kuadrant-operator-controller-manager-5f685c496f-lw2m7\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.548726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.548698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce59b60b-6653-4148-9d80-e6cfa536a68c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-lw2m7\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.567785 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.567755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8rt\" (UniqueName: \"kubernetes.io/projected/ce59b60b-6653-4148-9d80-e6cfa536a68c-kube-api-access-kx8rt\") pod \"kuadrant-operator-controller-manager-5f685c496f-lw2m7\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.648066 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.648037    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:54.648643 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.648620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwtk\" (UniqueName: \"kubernetes.io/projected/3ea1abdf-c837-4769-869f-b39a2a8e573b-kube-api-access-6dwtk\") pod \"limitador-operator-controller-manager-74495c69f8-lpgsg\" (UID: \"3ea1abdf-c837-4769-869f-b39a2a8e573b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:03:54.650328 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.650302    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:54.651134 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.651112    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:54.652297 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.652277    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcn9c\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:54.654830 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.654812    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:54.656670 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:54.656645    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcn9c\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:54.659746 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.659726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwtk\" (UniqueName: \"kubernetes.io/projected/3ea1abdf-c837-4769-869f-b39a2a8e573b-kube-api-access-6dwtk\") pod \"limitador-operator-controller-manager-74495c69f8-lpgsg\" (UID: \"3ea1abdf-c837-4769-869f-b39a2a8e573b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:03:54.687415 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.687323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:54.750023 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.749995    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l2hh\" (UniqueName: \"kubernetes.io/projected/7d440753-6f0c-408d-a9c3-d078bb0468a9-kube-api-access-6l2hh\") pod \"7d440753-6f0c-408d-a9c3-d078bb0468a9\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") "
Sep 09 16:03:54.750189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.750062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jw22\" (UniqueName: \"kubernetes.io/projected/06823eb6-7def-44ba-8240-6aff15d336fa-kube-api-access-2jw22\") pod \"06823eb6-7def-44ba-8240-6aff15d336fa\" (UID: \"06823eb6-7def-44ba-8240-6aff15d336fa\") "
Sep 09 16:03:54.750189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.750085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d440753-6f0c-408d-a9c3-d078bb0468a9-extensions-socket-volume\") pod \"7d440753-6f0c-408d-a9c3-d078bb0468a9\" (UID: \"7d440753-6f0c-408d-a9c3-d078bb0468a9\") "
Sep 09 16:03:54.750692 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.750662    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d440753-6f0c-408d-a9c3-d078bb0468a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d440753-6f0c-408d-a9c3-d078bb0468a9" (UID: "7d440753-6f0c-408d-a9c3-d078bb0468a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:54.752634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.752599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d440753-6f0c-408d-a9c3-d078bb0468a9-kube-api-access-6l2hh" (OuterVolumeSpecName: "kube-api-access-6l2hh") pod "7d440753-6f0c-408d-a9c3-d078bb0468a9" (UID: "7d440753-6f0c-408d-a9c3-d078bb0468a9"). InnerVolumeSpecName "kube-api-access-6l2hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:54.752741 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.752713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06823eb6-7def-44ba-8240-6aff15d336fa-kube-api-access-2jw22" (OuterVolumeSpecName: "kube-api-access-2jw22") pod "06823eb6-7def-44ba-8240-6aff15d336fa" (UID: "06823eb6-7def-44ba-8240-6aff15d336fa"). InnerVolumeSpecName "kube-api-access-2jw22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:54.802981 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.802942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:03:54.851911 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.851846    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l2hh\" (UniqueName: \"kubernetes.io/projected/7d440753-6f0c-408d-a9c3-d078bb0468a9-kube-api-access-6l2hh\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:54.852396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.852045    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jw22\" (UniqueName: \"kubernetes.io/projected/06823eb6-7def-44ba-8240-6aff15d336fa-kube-api-access-2jw22\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:54.852396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.852068    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d440753-6f0c-408d-a9c3-d078bb0468a9-extensions-socket-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:54.967154 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:54.967130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"]
Sep 09 16:03:54.969453 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:03:54.969424    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce59b60b_6653_4148_9d80_e6cfa536a68c.slice/crio-a665f0db3db7af062a2a6c51be0d5f5fd20c086f6cb41c6ca3e3eebbfde2d8ae WatchSource:0}: Error finding container a665f0db3db7af062a2a6c51be0d5f5fd20c086f6cb41c6ca3e3eebbfde2d8ae: Status 404 returned error can't find the container with id a665f0db3db7af062a2a6c51be0d5f5fd20c086f6cb41c6ca3e3eebbfde2d8ae
Sep 09 16:03:55.079135 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.079107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"]
Sep 09 16:03:55.082573 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:03:55.082547    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea1abdf_c837_4769_869f_b39a2a8e573b.slice/crio-a6b096e792d23c91d1cb04caece75387ca2441760b6257617a795d359e646de3 WatchSource:0}: Error finding container a6b096e792d23c91d1cb04caece75387ca2441760b6257617a795d359e646de3: Status 404 returned error can't find the container with id a6b096e792d23c91d1cb04caece75387ca2441760b6257617a795d359e646de3
Sep 09 16:03:55.283905 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.283818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7" event={"ID":"ce59b60b-6653-4148-9d80-e6cfa536a68c","Type":"ContainerStarted","Data":"c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7"}
Sep 09 16:03:55.283905 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.283881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7" event={"ID":"ce59b60b-6653-4148-9d80-e6cfa536a68c","Type":"ContainerStarted","Data":"a665f0db3db7af062a2a6c51be0d5f5fd20c086f6cb41c6ca3e3eebbfde2d8ae"}
Sep 09 16:03:55.284107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.284032    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:03:55.285594 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.285570    2578 generic.go:356] "Generic (PLEG): container finished" podID="06823eb6-7def-44ba-8240-6aff15d336fa" containerID="0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7" exitCode=0
Sep 09 16:03:55.285738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.285604    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:55.285738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.285654    2578 scope.go:117] "RemoveContainer" containerID="0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7"
Sep 09 16:03:55.286595 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.286565    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcn9c\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:55.287738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.287706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg" event={"ID":"3ea1abdf-c837-4769-869f-b39a2a8e573b","Type":"ContainerStarted","Data":"5d1191c1bcba45e62f33be8701fdcdb45d42207df155544f17e1eab64d939bd8"}
Sep 09 16:03:55.287861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.287767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg" event={"ID":"3ea1abdf-c837-4769-869f-b39a2a8e573b","Type":"ContainerStarted","Data":"a6b096e792d23c91d1cb04caece75387ca2441760b6257617a795d359e646de3"}
Sep 09 16:03:55.287931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.287896    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:03:55.289330 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.289312    2578 generic.go:356] "Generic (PLEG): container finished" podID="7d440753-6f0c-408d-a9c3-d078bb0468a9" containerID="cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8" exitCode=0
Sep 09 16:03:55.289440 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.289344    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:55.289662 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.289644    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j" container="manager"
Sep 09 16:03:55.296727 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.296705    2578 scope.go:117] "RemoveContainer" containerID="0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7"
Sep 09 16:03:55.297073 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.297048    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7\": container with ID starting with 0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7 not found: ID does not exist" containerID="0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7"
Sep 09 16:03:55.297143 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.297088    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7"} err="failed to get container status \"0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7\": rpc error: code = NotFound desc = could not find container \"0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7\": container with ID starting with 0cfacf4ad2ba9695b3a063f2600c32b4f0b22ceb0518c5718eb16b2816b2cbe7 not found: ID does not exist"
Sep 09 16:03:55.297143 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.297114    2578 scope.go:117] "RemoveContainer" containerID="cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8"
Sep 09 16:03:55.308052 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.308032    2578 scope.go:117] "RemoveContainer" containerID="cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8"
Sep 09 16:03:55.308420 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.308399    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8\": container with ID starting with cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8 not found: ID does not exist" containerID="cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8"
Sep 09 16:03:55.308503 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.308427    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8"} err="failed to get container status \"cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8\": rpc error: code = NotFound desc = could not find container \"cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8\": container with ID starting with cc4670e2cb6bd6384397b7ce43bdc83d05305c25be4052a15d724c2f4bef40d8 not found: ID does not exist"
Sep 09 16:03:55.323295 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.323241    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7" podStartSLOduration=1.3232152 podStartE2EDuration="1.3232152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:03:55.320483349 +0000 UTC m=+746.581612527" watchObservedRunningTime="2026-09-09 16:03:55.3232152 +0000 UTC m=+746.584344374"
Sep 09 16:03:55.324756 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.324731    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:55.326731 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.326708    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:55.330504 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.330479    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hfd9b\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfd9b"
Sep 09 16:03:55.334069 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:55.334050    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcn9c\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcn9c"
Sep 09 16:03:55.361239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.361190    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg" podStartSLOduration=1.361171691 podStartE2EDuration="1.361171691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:03:55.359591696 +0000 UTC m=+746.620720872" watchObservedRunningTime="2026-09-09 16:03:55.361171691 +0000 UTC m=+746.622300866"
Sep 09 16:03:55.368032 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.367996    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06823eb6-7def-44ba-8240-6aff15d336fa" path="/var/lib/kubelet/pods/06823eb6-7def-44ba-8240-6aff15d336fa/volumes"
Sep 09 16:03:55.368368 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:55.368335    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d440753-6f0c-408d-a9c3-d078bb0468a9" path="/var/lib/kubelet/pods/7d440753-6f0c-408d-a9c3-d078bb0468a9/volumes"
Sep 09 16:03:56.299488 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.299406    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" containerName="manager" containerID="cri-o://8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7" gracePeriod=2
Sep 09 16:03:56.547708 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.547675    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:56.569022 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.568924    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee0a740-99d1-4d53-89db-19f6231aa876-extensions-socket-volume\") pod \"4ee0a740-99d1-4d53-89db-19f6231aa876\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") "
Sep 09 16:03:56.569197 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.569051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-882d5\" (UniqueName: \"kubernetes.io/projected/4ee0a740-99d1-4d53-89db-19f6231aa876-kube-api-access-882d5\") pod \"4ee0a740-99d1-4d53-89db-19f6231aa876\" (UID: \"4ee0a740-99d1-4d53-89db-19f6231aa876\") "
Sep 09 16:03:56.569262 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.569200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee0a740-99d1-4d53-89db-19f6231aa876-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ee0a740-99d1-4d53-89db-19f6231aa876" (UID: "4ee0a740-99d1-4d53-89db-19f6231aa876"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:03:56.569333 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.569316    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee0a740-99d1-4d53-89db-19f6231aa876-extensions-socket-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:56.571110 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.571087    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee0a740-99d1-4d53-89db-19f6231aa876-kube-api-access-882d5" (OuterVolumeSpecName: "kube-api-access-882d5") pod "4ee0a740-99d1-4d53-89db-19f6231aa876" (UID: "4ee0a740-99d1-4d53-89db-19f6231aa876"). InnerVolumeSpecName "kube-api-access-882d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:03:56.670179 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:56.670141    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-882d5\" (UniqueName: \"kubernetes.io/projected/4ee0a740-99d1-4d53-89db-19f6231aa876-kube-api-access-882d5\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:03:57.306415 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:57.306381    2578 generic.go:356] "Generic (PLEG): container finished" podID="4ee0a740-99d1-4d53-89db-19f6231aa876" containerID="8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7" exitCode=2
Sep 09 16:03:57.306843 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:57.306426    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:57.306843 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:57.306496    2578 scope.go:117] "RemoveContainer" containerID="8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7"
Sep 09 16:03:57.308864 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:57.308839    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:57.315976 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:57.315959    2578 scope.go:117] "RemoveContainer" containerID="8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7"
Sep 09 16:03:57.316263 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:57.316243    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7\": container with ID starting with 8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7 not found: ID does not exist" containerID="8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7"
Sep 09 16:03:57.316323 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:57.316271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7"} err="failed to get container status \"8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7\": rpc error: code = NotFound desc = could not find container \"8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7\": container with ID starting with 8d1142e7fdb29ac24db0614f9c045ae510e32e3542aa84577651be450c5e66f7 not found: ID does not exist"
Sep 09 16:03:57.317478 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:03:57.317457    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-rfh9j\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-rfh9j"
Sep 09 16:03:57.367707 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:03:57.367667    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee0a740-99d1-4d53-89db-19f6231aa876" path="/var/lib/kubelet/pods/4ee0a740-99d1-4d53-89db-19f6231aa876/volumes"
Sep 09 16:04:06.301385 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.301328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:04:06.301855 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.301433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lpgsg"
Sep 09 16:04:06.654622 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.654587    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"]
Sep 09 16:04:06.658442 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.658419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.670801 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.670773    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"]
Sep 09 16:04:06.761072 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.761034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdmb\" (UniqueName: \"kubernetes.io/projected/7f4d0d33-446e-4c3e-928a-466a0664fac0-kube-api-access-qtdmb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dn9rv\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.761248 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.761141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f4d0d33-446e-4c3e-928a-466a0664fac0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dn9rv\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.861884 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.861783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f4d0d33-446e-4c3e-928a-466a0664fac0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dn9rv\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.861884 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.861837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdmb\" (UniqueName: \"kubernetes.io/projected/7f4d0d33-446e-4c3e-928a-466a0664fac0-kube-api-access-qtdmb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dn9rv\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.862716 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.862685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f4d0d33-446e-4c3e-928a-466a0664fac0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dn9rv\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.879734 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.879706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdmb\" (UniqueName: \"kubernetes.io/projected/7f4d0d33-446e-4c3e-928a-466a0664fac0-kube-api-access-qtdmb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dn9rv\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:06.969373 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:06.969312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:07.254900 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:07.254873    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"]
Sep 09 16:04:07.256676 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:04:07.256643    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4d0d33_446e_4c3e_928a_466a0664fac0.slice/crio-be1caed394f79f8fcbd714cc29fd90bb72bbd2ed61181dd19312a9a0b42bc5be WatchSource:0}: Error finding container be1caed394f79f8fcbd714cc29fd90bb72bbd2ed61181dd19312a9a0b42bc5be: Status 404 returned error can't find the container with id be1caed394f79f8fcbd714cc29fd90bb72bbd2ed61181dd19312a9a0b42bc5be
Sep 09 16:04:07.366920 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:07.366885    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:07.367311 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:07.366945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv" event={"ID":"7f4d0d33-446e-4c3e-928a-466a0664fac0","Type":"ContainerStarted","Data":"cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d"}
Sep 09 16:04:07.367311 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:07.366976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv" event={"ID":"7f4d0d33-446e-4c3e-928a-466a0664fac0","Type":"ContainerStarted","Data":"be1caed394f79f8fcbd714cc29fd90bb72bbd2ed61181dd19312a9a0b42bc5be"}
Sep 09 16:04:07.385122 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:07.385070    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv" podStartSLOduration=1.385053544 podStartE2EDuration="1.385053544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:04:07.383793414 +0000 UTC m=+758.644922591" watchObservedRunningTime="2026-09-09 16:04:07.385053544 +0000 UTC m=+758.646182720"
Sep 09 16:04:18.369861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.369830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:04:18.420850 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.420812    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"]
Sep 09 16:04:18.421100 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.421071    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7" podUID="ce59b60b-6653-4148-9d80-e6cfa536a68c" containerName="manager" containerID="cri-o://c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7" gracePeriod=10
Sep 09 16:04:18.664053 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.664031    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:04:18.763136 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.763109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx8rt\" (UniqueName: \"kubernetes.io/projected/ce59b60b-6653-4148-9d80-e6cfa536a68c-kube-api-access-kx8rt\") pod \"ce59b60b-6653-4148-9d80-e6cfa536a68c\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") "
Sep 09 16:04:18.763307 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.763166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce59b60b-6653-4148-9d80-e6cfa536a68c-extensions-socket-volume\") pod \"ce59b60b-6653-4148-9d80-e6cfa536a68c\" (UID: \"ce59b60b-6653-4148-9d80-e6cfa536a68c\") "
Sep 09 16:04:18.763587 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.763563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce59b60b-6653-4148-9d80-e6cfa536a68c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce59b60b-6653-4148-9d80-e6cfa536a68c" (UID: "ce59b60b-6653-4148-9d80-e6cfa536a68c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:04:18.765186 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.765162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce59b60b-6653-4148-9d80-e6cfa536a68c-kube-api-access-kx8rt" (OuterVolumeSpecName: "kube-api-access-kx8rt") pod "ce59b60b-6653-4148-9d80-e6cfa536a68c" (UID: "ce59b60b-6653-4148-9d80-e6cfa536a68c"). InnerVolumeSpecName "kube-api-access-kx8rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:04:18.864912 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.864875    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx8rt\" (UniqueName: \"kubernetes.io/projected/ce59b60b-6653-4148-9d80-e6cfa536a68c-kube-api-access-kx8rt\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:04:18.864912 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:18.864906    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce59b60b-6653-4148-9d80-e6cfa536a68c-extensions-socket-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:04:19.432002 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.431969    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce59b60b-6653-4148-9d80-e6cfa536a68c" containerID="c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7" exitCode=0
Sep 09 16:04:19.432396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.432020    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"
Sep 09 16:04:19.432396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.432022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7" event={"ID":"ce59b60b-6653-4148-9d80-e6cfa536a68c","Type":"ContainerDied","Data":"c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7"}
Sep 09 16:04:19.432396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.432144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7" event={"ID":"ce59b60b-6653-4148-9d80-e6cfa536a68c","Type":"ContainerDied","Data":"a665f0db3db7af062a2a6c51be0d5f5fd20c086f6cb41c6ca3e3eebbfde2d8ae"}
Sep 09 16:04:19.432396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.432180    2578 scope.go:117] "RemoveContainer" containerID="c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7"
Sep 09 16:04:19.440878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.440834    2578 scope.go:117] "RemoveContainer" containerID="c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7"
Sep 09 16:04:19.441122 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:04:19.441103    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7\": container with ID starting with c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7 not found: ID does not exist" containerID="c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7"
Sep 09 16:04:19.441187 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.441130    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7"} err="failed to get container status \"c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7\": rpc error: code = NotFound desc = could not find container \"c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7\": container with ID starting with c22f565fd8935ab85298b7f1db78fc68e71804de11579d6f2e1dae5e0fb53aa7 not found: ID does not exist"
Sep 09 16:04:19.452520 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.452498    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"]
Sep 09 16:04:19.456212 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:19.456190    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-lw2m7"]
Sep 09 16:04:21.367631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:21.367596    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce59b60b-6653-4148-9d80-e6cfa536a68c" path="/var/lib/kubelet/pods/ce59b60b-6653-4148-9d80-e6cfa536a68c/volumes"
Sep 09 16:04:36.114571 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.114534    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:36.114945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.114884    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce59b60b-6653-4148-9d80-e6cfa536a68c" containerName="manager"
Sep 09 16:04:36.114945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.114899    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce59b60b-6653-4148-9d80-e6cfa536a68c" containerName="manager"
Sep 09 16:04:36.115020 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.114971    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce59b60b-6653-4148-9d80-e6cfa536a68c" containerName="manager"
Sep 09 16:04:36.119430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.119412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.121920 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.121901    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 16:04:36.122074 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.121939    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2mfjz\""
Sep 09 16:04:36.125602 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.125576    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:36.209755 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.209720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a49eb-0d9c-4435-a866-83926bcb3fa5-config-file\") pod \"limitador-limitador-8588749977-wn55w\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") " pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.209974 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.209770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqd2q\" (UniqueName: \"kubernetes.io/projected/593a49eb-0d9c-4435-a866-83926bcb3fa5-kube-api-access-cqd2q\") pod \"limitador-limitador-8588749977-wn55w\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") " pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.217594 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.217566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:36.310545 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.310511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a49eb-0d9c-4435-a866-83926bcb3fa5-config-file\") pod \"limitador-limitador-8588749977-wn55w\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") " pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.310718 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.310556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqd2q\" (UniqueName: \"kubernetes.io/projected/593a49eb-0d9c-4435-a866-83926bcb3fa5-kube-api-access-cqd2q\") pod \"limitador-limitador-8588749977-wn55w\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") " pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.311154 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.311136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a49eb-0d9c-4435-a866-83926bcb3fa5-config-file\") pod \"limitador-limitador-8588749977-wn55w\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") " pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.321436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.321414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqd2q\" (UniqueName: \"kubernetes.io/projected/593a49eb-0d9c-4435-a866-83926bcb3fa5-kube-api-access-cqd2q\") pod \"limitador-limitador-8588749977-wn55w\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") " pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.431245 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.431160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:36.701379 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:36.701333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:36.702749 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:04:36.702723    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593a49eb_0d9c_4435_a866_83926bcb3fa5.slice/crio-b79d05de795a24459710bcbc0385714e513e617a37aefb482d79d5bfb0de908d WatchSource:0}: Error finding container b79d05de795a24459710bcbc0385714e513e617a37aefb482d79d5bfb0de908d: Status 404 returned error can't find the container with id b79d05de795a24459710bcbc0385714e513e617a37aefb482d79d5bfb0de908d
Sep 09 16:04:37.533140 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:37.533105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wn55w" event={"ID":"593a49eb-0d9c-4435-a866-83926bcb3fa5","Type":"ContainerStarted","Data":"b79d05de795a24459710bcbc0385714e513e617a37aefb482d79d5bfb0de908d"}
Sep 09 16:04:39.545447 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:39.545409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wn55w" event={"ID":"593a49eb-0d9c-4435-a866-83926bcb3fa5","Type":"ContainerStarted","Data":"edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141"}
Sep 09 16:04:39.545840 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:39.545528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:39.561250 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:39.561197    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-wn55w" podStartSLOduration=1.604392738 podStartE2EDuration="3.561181794s" totalImagesPullingTime="1.956789056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:04:39.559861731 +0000 UTC m=+790.820990907" watchObservedRunningTime="2026-09-09 16:04:39.561181794 +0000 UTC m=+790.822310970"
Sep 09 16:04:49.421993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:49.421952    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:49.422646 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:49.422193    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-wn55w" podUID="593a49eb-0d9c-4435-a866-83926bcb3fa5" containerName="limitador" containerID="cri-o://edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141" gracePeriod=30
Sep 09 16:04:49.423062 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:49.423001    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:49.968769 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:49.968747    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:50.008626 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.008548    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqd2q\" (UniqueName: \"kubernetes.io/projected/593a49eb-0d9c-4435-a866-83926bcb3fa5-kube-api-access-cqd2q\") pod \"593a49eb-0d9c-4435-a866-83926bcb3fa5\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") "
Sep 09 16:04:50.008626 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.008597    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a49eb-0d9c-4435-a866-83926bcb3fa5-config-file\") pod \"593a49eb-0d9c-4435-a866-83926bcb3fa5\" (UID: \"593a49eb-0d9c-4435-a866-83926bcb3fa5\") "
Sep 09 16:04:50.008975 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.008954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/593a49eb-0d9c-4435-a866-83926bcb3fa5-config-file" (OuterVolumeSpecName: "config-file") pod "593a49eb-0d9c-4435-a866-83926bcb3fa5" (UID: "593a49eb-0d9c-4435-a866-83926bcb3fa5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:04:50.010508 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.010485    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593a49eb-0d9c-4435-a866-83926bcb3fa5-kube-api-access-cqd2q" (OuterVolumeSpecName: "kube-api-access-cqd2q") pod "593a49eb-0d9c-4435-a866-83926bcb3fa5" (UID: "593a49eb-0d9c-4435-a866-83926bcb3fa5"). InnerVolumeSpecName "kube-api-access-cqd2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:04:50.109817 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.109789    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqd2q\" (UniqueName: \"kubernetes.io/projected/593a49eb-0d9c-4435-a866-83926bcb3fa5-kube-api-access-cqd2q\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:04:50.109817 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.109812    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/593a49eb-0d9c-4435-a866-83926bcb3fa5-config-file\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:04:50.603058 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.603025    2578 generic.go:356] "Generic (PLEG): container finished" podID="593a49eb-0d9c-4435-a866-83926bcb3fa5" containerID="edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141" exitCode=0
Sep 09 16:04:50.603530 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.603071    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wn55w"
Sep 09 16:04:50.603530 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.603114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wn55w" event={"ID":"593a49eb-0d9c-4435-a866-83926bcb3fa5","Type":"ContainerDied","Data":"edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141"}
Sep 09 16:04:50.603530 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.603176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wn55w" event={"ID":"593a49eb-0d9c-4435-a866-83926bcb3fa5","Type":"ContainerDied","Data":"b79d05de795a24459710bcbc0385714e513e617a37aefb482d79d5bfb0de908d"}
Sep 09 16:04:50.603530 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.603211    2578 scope.go:117] "RemoveContainer" containerID="edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141"
Sep 09 16:04:50.612380 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.612362    2578 scope.go:117] "RemoveContainer" containerID="edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141"
Sep 09 16:04:50.612634 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:04:50.612618    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141\": container with ID starting with edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141 not found: ID does not exist" containerID="edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141"
Sep 09 16:04:50.612696 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.612642    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141"} err="failed to get container status \"edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141\": rpc error: code = NotFound desc = could not find container \"edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141\": container with ID starting with edae230d46777f9cd3d020883ec54fd1d124a04181d1e4031d82db98605f9141 not found: ID does not exist"
Sep 09 16:04:50.624178 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.624154    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:50.629376 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:50.629339    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wn55w"]
Sep 09 16:04:51.367272 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:51.367201    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593a49eb-0d9c-4435-a866-83926bcb3fa5" path="/var/lib/kubelet/pods/593a49eb-0d9c-4435-a866-83926bcb3fa5/volumes"
Sep 09 16:04:52.237384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.237332    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"]
Sep 09 16:04:52.237740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.237685    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593a49eb-0d9c-4435-a866-83926bcb3fa5" containerName="limitador"
Sep 09 16:04:52.237740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.237697    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="593a49eb-0d9c-4435-a866-83926bcb3fa5" containerName="limitador"
Sep 09 16:04:52.237811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.237755    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="593a49eb-0d9c-4435-a866-83926bcb3fa5" containerName="limitador"
Sep 09 16:04:52.242007 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.241982    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.245107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.245088    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 16:04:52.245257 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.245195    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 16:04:52.245881 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.245861    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 16:04:52.246369 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.246329    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jtdgr\""
Sep 09 16:04:52.251227 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.251207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"]
Sep 09 16:04:52.321142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.321119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3613e5f2-c90e-42c1-bf18-f98ebde128a8-data\") pod \"postgres-69fb4594cf-nfrql\" (UID: \"3613e5f2-c90e-42c1-bf18-f98ebde128a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.321237 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.321161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25rpn\" (UniqueName: \"kubernetes.io/projected/3613e5f2-c90e-42c1-bf18-f98ebde128a8-kube-api-access-25rpn\") pod \"postgres-69fb4594cf-nfrql\" (UID: \"3613e5f2-c90e-42c1-bf18-f98ebde128a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.422481 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.422456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3613e5f2-c90e-42c1-bf18-f98ebde128a8-data\") pod \"postgres-69fb4594cf-nfrql\" (UID: \"3613e5f2-c90e-42c1-bf18-f98ebde128a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.422573 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.422497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25rpn\" (UniqueName: \"kubernetes.io/projected/3613e5f2-c90e-42c1-bf18-f98ebde128a8-kube-api-access-25rpn\") pod \"postgres-69fb4594cf-nfrql\" (UID: \"3613e5f2-c90e-42c1-bf18-f98ebde128a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.422786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.422770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3613e5f2-c90e-42c1-bf18-f98ebde128a8-data\") pod \"postgres-69fb4594cf-nfrql\" (UID: \"3613e5f2-c90e-42c1-bf18-f98ebde128a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.431537 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.431515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25rpn\" (UniqueName: \"kubernetes.io/projected/3613e5f2-c90e-42c1-bf18-f98ebde128a8-kube-api-access-25rpn\") pod \"postgres-69fb4594cf-nfrql\" (UID: \"3613e5f2-c90e-42c1-bf18-f98ebde128a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.552714 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.552664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:52.826183 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:52.826155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"]
Sep 09 16:04:52.827585 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:04:52.827560    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3613e5f2_c90e_42c1_bf18_f98ebde128a8.slice/crio-380436af7529f4f83018087fd831993bc4ee28bab4b83875d9ecfafa0334ce7e WatchSource:0}: Error finding container 380436af7529f4f83018087fd831993bc4ee28bab4b83875d9ecfafa0334ce7e: Status 404 returned error can't find the container with id 380436af7529f4f83018087fd831993bc4ee28bab4b83875d9ecfafa0334ce7e
Sep 09 16:04:53.625773 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:53.625702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql" event={"ID":"3613e5f2-c90e-42c1-bf18-f98ebde128a8","Type":"ContainerStarted","Data":"380436af7529f4f83018087fd831993bc4ee28bab4b83875d9ecfafa0334ce7e"}
Sep 09 16:04:58.658590 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:58.658550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql" event={"ID":"3613e5f2-c90e-42c1-bf18-f98ebde128a8","Type":"ContainerStarted","Data":"7a27fb07729c10c0f36ac595ddf1778226c18394cfabb79f7e853ca73fc5cab0"}
Sep 09 16:04:58.658978 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:58.658665    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:04:58.675364 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:04:58.675302    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql" podStartSLOduration=1.925228734 podStartE2EDuration="6.67528489s" totalImagesPullingTime="4.750056156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:04:58.673068223 +0000 UTC m=+809.934197398" watchObservedRunningTime="2026-09-09 16:04:58.67528489 +0000 UTC m=+809.936414065"
Sep 09 16:05:04.693401 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:04.693373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nfrql"
Sep 09 16:05:13.710158 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.710123    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55cb885958-4nsg6"]
Sep 09 16:05:13.734473 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.734441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55cb885958-4nsg6"]
Sep 09 16:05:13.734657 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.734550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.737286 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.737259    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:05:13.737443 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.737259    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:05:13.737443 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.737345    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w87qf\""
Sep 09 16:05:13.738037 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.738013    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:05:13.804578 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.804549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzvl\" (UniqueName: \"kubernetes.io/projected/145f3448-ac02-4c7f-919f-724f73ce0660-kube-api-access-zrzvl\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.804738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.804616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.804738 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.804671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.893037 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.892996    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-stqcb"]
Sep 09 16:05:13.896638 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.896616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:13.905170 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.905149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzvl\" (UniqueName: \"kubernetes.io/projected/145f3448-ac02-4c7f-919f-724f73ce0660-kube-api-access-zrzvl\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.905316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.905300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.905414 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.905361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:13.905488 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:13.905467    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 09 16:05:13.905546 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:13.905467    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 16:05:13.905546 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:13.905536    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert podName:145f3448-ac02-4c7f-919f-724f73ce0660 nodeName:}" failed. No retries permitted until 2026-09-09 16:05:14.405517093 +0000 UTC m=+825.666646252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert") pod "maas-controller-55cb885958-4nsg6" (UID: "145f3448-ac02-4c7f-919f-724f73ce0660") : secret "maas-controller-webhook-cert" not found
Sep 09 16:05:13.905662 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:13.905609    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs podName:145f3448-ac02-4c7f-919f-724f73ce0660 nodeName:}" failed. No retries permitted until 2026-09-09 16:05:14.405572043 +0000 UTC m=+825.666701211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs") pod "maas-controller-55cb885958-4nsg6" (UID: "145f3448-ac02-4c7f-919f-724f73ce0660") : secret "maas-controller-metrics-tls" not found
Sep 09 16:05:13.906058 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.906035    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-stqcb"]
Sep 09 16:05:13.914307 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:13.914281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzvl\" (UniqueName: \"kubernetes.io/projected/145f3448-ac02-4c7f-919f-724f73ce0660-kube-api-access-zrzvl\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:14.006809 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.006728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.006809 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.006775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dp8b\" (UniqueName: \"kubernetes.io/projected/710c0d01-c0d0-45c7-be17-59d3befbfc03-kube-api-access-6dp8b\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.006986 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.006864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-metrics-certs\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.107370 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.107308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.107531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.107395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dp8b\" (UniqueName: \"kubernetes.io/projected/710c0d01-c0d0-45c7-be17-59d3befbfc03-kube-api-access-6dp8b\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.107531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.107438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-metrics-certs\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.107531 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:14.107465    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 09 16:05:14.107531 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:14.107525    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert podName:710c0d01-c0d0-45c7-be17-59d3befbfc03 nodeName:}" failed. No retries permitted until 2026-09-09 16:05:14.607510162 +0000 UTC m=+825.868639320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert") pod "maas-controller-7b4d875bf9-stqcb" (UID: "710c0d01-c0d0-45c7-be17-59d3befbfc03") : secret "maas-controller-webhook-cert" not found
Sep 09 16:05:14.109926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.109902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-metrics-certs\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.117947 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.117919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dp8b\" (UniqueName: \"kubernetes.io/projected/710c0d01-c0d0-45c7-be17-59d3befbfc03-kube-api-access-6dp8b\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.409212 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.409115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:14.409420 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.409217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:14.411644 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.411622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:14.411755 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.411624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert\") pod \"maas-controller-55cb885958-4nsg6\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") " pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:14.610891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.610850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.613211 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.613181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert\") pod \"maas-controller-7b4d875bf9-stqcb\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") " pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.645314 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.645268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:14.807974 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.807937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:14.916400 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:14.916372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55cb885958-4nsg6"]
Sep 09 16:05:14.917471 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:05:14.917437    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145f3448_ac02_4c7f_919f_724f73ce0660.slice/crio-d363033fb05c5ef807625dfbc126055bb50e5b5d14341d9c510a1ec3c2e44720 WatchSource:0}: Error finding container d363033fb05c5ef807625dfbc126055bb50e5b5d14341d9c510a1ec3c2e44720: Status 404 returned error can't find the container with id d363033fb05c5ef807625dfbc126055bb50e5b5d14341d9c510a1ec3c2e44720
Sep 09 16:05:15.081865 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:15.081836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-stqcb"]
Sep 09 16:05:15.082961 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:05:15.082933    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710c0d01_c0d0_45c7_be17_59d3befbfc03.slice/crio-2680a7e95864763c3c5d2e15d8652fc09d3cf7fc170004904591046c2f180003 WatchSource:0}: Error finding container 2680a7e95864763c3c5d2e15d8652fc09d3cf7fc170004904591046c2f180003: Status 404 returned error can't find the container with id 2680a7e95864763c3c5d2e15d8652fc09d3cf7fc170004904591046c2f180003
Sep 09 16:05:15.755883 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:15.755838    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-stqcb" event={"ID":"710c0d01-c0d0-45c7-be17-59d3befbfc03","Type":"ContainerStarted","Data":"2680a7e95864763c3c5d2e15d8652fc09d3cf7fc170004904591046c2f180003"}
Sep 09 16:05:15.757859 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:15.757797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55cb885958-4nsg6" event={"ID":"145f3448-ac02-4c7f-919f-724f73ce0660","Type":"ContainerStarted","Data":"d363033fb05c5ef807625dfbc126055bb50e5b5d14341d9c510a1ec3c2e44720"}
Sep 09 16:05:17.771513 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:17.771478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-stqcb" event={"ID":"710c0d01-c0d0-45c7-be17-59d3befbfc03","Type":"ContainerStarted","Data":"3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916"}
Sep 09 16:05:17.771940 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:17.771605    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:17.773400 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:17.773375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55cb885958-4nsg6" event={"ID":"145f3448-ac02-4c7f-919f-724f73ce0660","Type":"ContainerStarted","Data":"0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f"}
Sep 09 16:05:17.773603 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:17.773581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:17.789048 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:17.789002    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b4d875bf9-stqcb" podStartSLOduration=2.191592452 podStartE2EDuration="4.788985738s" totalImagesPullingTime="2.597393286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:05:17.787921782 +0000 UTC m=+829.049050959" watchObservedRunningTime="2026-09-09 16:05:17.788985738 +0000 UTC m=+829.050114914"
Sep 09 16:05:17.806658 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:17.806594    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55cb885958-4nsg6" podStartSLOduration=2.036128979 podStartE2EDuration="4.806575719s" totalImagesPullingTime="2.77044674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:05:17.806094948 +0000 UTC m=+829.067224127" watchObservedRunningTime="2026-09-09 16:05:17.806575719 +0000 UTC m=+829.067704954"
Sep 09 16:05:28.782648 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:28.782617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:28.783080 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:28.782687    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:05:28.857793 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:28.857758    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55cb885958-4nsg6"]
Sep 09 16:05:28.857993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:28.857973    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55cb885958-4nsg6" podUID="145f3448-ac02-4c7f-919f-724f73ce0660" containerName="manager" containerID="cri-o://0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f" gracePeriod=30
Sep 09 16:05:29.107416 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.107393    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:29.244792 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.244760    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert\") pod \"145f3448-ac02-4c7f-919f-724f73ce0660\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") "
Sep 09 16:05:29.244898 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.244822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrzvl\" (UniqueName: \"kubernetes.io/projected/145f3448-ac02-4c7f-919f-724f73ce0660-kube-api-access-zrzvl\") pod \"145f3448-ac02-4c7f-919f-724f73ce0660\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") "
Sep 09 16:05:29.244898 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.244879    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs\") pod \"145f3448-ac02-4c7f-919f-724f73ce0660\" (UID: \"145f3448-ac02-4c7f-919f-724f73ce0660\") "
Sep 09 16:05:29.246989 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.246956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/145f3448-ac02-4c7f-919f-724f73ce0660-kube-api-access-zrzvl" (OuterVolumeSpecName: "kube-api-access-zrzvl") pod "145f3448-ac02-4c7f-919f-724f73ce0660" (UID: "145f3448-ac02-4c7f-919f-724f73ce0660"). InnerVolumeSpecName "kube-api-access-zrzvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:05:29.246989 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.246957    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "145f3448-ac02-4c7f-919f-724f73ce0660" (UID: "145f3448-ac02-4c7f-919f-724f73ce0660"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:05:29.246989 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.246983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "145f3448-ac02-4c7f-919f-724f73ce0660" (UID: "145f3448-ac02-4c7f-919f-724f73ce0660"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:05:29.345675 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.345598    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-webhook-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:05:29.345675 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.345622    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrzvl\" (UniqueName: \"kubernetes.io/projected/145f3448-ac02-4c7f-919f-724f73ce0660-kube-api-access-zrzvl\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:05:29.345675 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.345630    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/145f3448-ac02-4c7f-919f-724f73ce0660-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:05:29.841006 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.840971    2578 generic.go:356] "Generic (PLEG): container finished" podID="145f3448-ac02-4c7f-919f-724f73ce0660" containerID="0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f" exitCode=0
Sep 09 16:05:29.841418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.841013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55cb885958-4nsg6"
Sep 09 16:05:29.841418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.841050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55cb885958-4nsg6" event={"ID":"145f3448-ac02-4c7f-919f-724f73ce0660","Type":"ContainerDied","Data":"0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f"}
Sep 09 16:05:29.841418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.841102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55cb885958-4nsg6" event={"ID":"145f3448-ac02-4c7f-919f-724f73ce0660","Type":"ContainerDied","Data":"d363033fb05c5ef807625dfbc126055bb50e5b5d14341d9c510a1ec3c2e44720"}
Sep 09 16:05:29.841418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.841127    2578 scope.go:117] "RemoveContainer" containerID="0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f"
Sep 09 16:05:29.849505 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.849490    2578 scope.go:117] "RemoveContainer" containerID="0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f"
Sep 09 16:05:29.849789 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:05:29.849769    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f\": container with ID starting with 0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f not found: ID does not exist" containerID="0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f"
Sep 09 16:05:29.849840 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.849798    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f"} err="failed to get container status \"0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f\": rpc error: code = NotFound desc = could not find container \"0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f\": container with ID starting with 0cc93ed3f0f82fc3abb90d0de903e3a252c6d71b447cf5e2ea9536b753ab8e7f not found: ID does not exist"
Sep 09 16:05:29.862250 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.862226    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55cb885958-4nsg6"]
Sep 09 16:05:29.866045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:29.866019    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55cb885958-4nsg6"]
Sep 09 16:05:31.367532 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:31.367496    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="145f3448-ac02-4c7f-919f-724f73ce0660" path="/var/lib/kubelet/pods/145f3448-ac02-4c7f-919f-724f73ce0660/volumes"
Sep 09 16:05:51.241157 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.241123    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"]
Sep 09 16:05:51.241600 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.241516    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145f3448-ac02-4c7f-919f-724f73ce0660" containerName="manager"
Sep 09 16:05:51.241600 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.241529    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="145f3448-ac02-4c7f-919f-724f73ce0660" containerName="manager"
Sep 09 16:05:51.241600 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.241593    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="145f3448-ac02-4c7f-919f-724f73ce0660" containerName="manager"
Sep 09 16:05:51.246196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.246179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.250141 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.250114    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n2qxg\""
Sep 09 16:05:51.250141 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.250133    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 16:05:51.250338 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.250114    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 16:05:51.258645 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.258611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"]
Sep 09 16:05:51.329512 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.329472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-maas-api-tls\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.329512 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.329513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-metrics-certs\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.329752 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.329547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6srp\" (UniqueName: \"kubernetes.io/projected/4caf2c22-7708-4775-97b9-9f500035b25b-kube-api-access-w6srp\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.329752 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.329604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf2c22-7708-4775-97b9-9f500035b25b-openshift-service-ca\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.430597 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.430559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf2c22-7708-4775-97b9-9f500035b25b-openshift-service-ca\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.430785 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.430666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-maas-api-tls\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.430785 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.430693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-metrics-certs\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.430785 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.430720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6srp\" (UniqueName: \"kubernetes.io/projected/4caf2c22-7708-4775-97b9-9f500035b25b-kube-api-access-w6srp\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.431287 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.431262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf2c22-7708-4775-97b9-9f500035b25b-openshift-service-ca\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.433059 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.433038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-metrics-certs\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.433146 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.433068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-maas-api-tls\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.441789 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.441766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6srp\" (UniqueName: \"kubernetes.io/projected/4caf2c22-7708-4775-97b9-9f500035b25b-kube-api-access-w6srp\") pod \"maas-api-6b4b89c5b5-9bg72\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.557178 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.557101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:51.783656 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.783619    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"]
Sep 09 16:05:51.786490 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.786459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.789209 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.789179    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 16:05:51.789395 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.789271    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-66cvm\""
Sep 09 16:05:51.800335 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.800301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"]
Sep 09 16:05:51.833705 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.833608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4n56\" (UniqueName: \"kubernetes.io/projected/816139fc-4aa6-4afe-9ad4-37008de3b432-kube-api-access-k4n56\") pod \"payload-processing-5b54b7fbb7-pw6qh\" (UID: \"816139fc-4aa6-4afe-9ad4-37008de3b432\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.833705 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.833664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/816139fc-4aa6-4afe-9ad4-37008de3b432-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pw6qh\" (UID: \"816139fc-4aa6-4afe-9ad4-37008de3b432\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.849180 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.845333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"]
Sep 09 16:05:51.934278 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.934243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/816139fc-4aa6-4afe-9ad4-37008de3b432-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pw6qh\" (UID: \"816139fc-4aa6-4afe-9ad4-37008de3b432\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.934510 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.934321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4n56\" (UniqueName: \"kubernetes.io/projected/816139fc-4aa6-4afe-9ad4-37008de3b432-kube-api-access-k4n56\") pod \"payload-processing-5b54b7fbb7-pw6qh\" (UID: \"816139fc-4aa6-4afe-9ad4-37008de3b432\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.935094 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.935063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/816139fc-4aa6-4afe-9ad4-37008de3b432-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pw6qh\" (UID: \"816139fc-4aa6-4afe-9ad4-37008de3b432\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.942887 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.942859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4n56\" (UniqueName: \"kubernetes.io/projected/816139fc-4aa6-4afe-9ad4-37008de3b432-kube-api-access-k4n56\") pod \"payload-processing-5b54b7fbb7-pw6qh\" (UID: \"816139fc-4aa6-4afe-9ad4-37008de3b432\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:51.960042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:51.960008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" event={"ID":"4caf2c22-7708-4775-97b9-9f500035b25b","Type":"ContainerStarted","Data":"d08aab96dab64b13095612a2ccdd0dd409a0af4f25bfa52543d3d62fe395b49a"}
Sep 09 16:05:52.101205 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:52.101122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:52.374751 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:52.374721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"]
Sep 09 16:05:52.376145 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:05:52.376116    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816139fc_4aa6_4afe_9ad4_37008de3b432.slice/crio-ea50c9f5507ae4149650fdc495be9e309cf98f69361d7fbc48cef726bc0b5517 WatchSource:0}: Error finding container ea50c9f5507ae4149650fdc495be9e309cf98f69361d7fbc48cef726bc0b5517: Status 404 returned error can't find the container with id ea50c9f5507ae4149650fdc495be9e309cf98f69361d7fbc48cef726bc0b5517
Sep 09 16:05:52.968599 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:52.968556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh" event={"ID":"816139fc-4aa6-4afe-9ad4-37008de3b432","Type":"ContainerStarted","Data":"ea50c9f5507ae4149650fdc495be9e309cf98f69361d7fbc48cef726bc0b5517"}
Sep 09 16:05:53.976686 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:53.976648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" event={"ID":"4caf2c22-7708-4775-97b9-9f500035b25b","Type":"ContainerStarted","Data":"05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68"}
Sep 09 16:05:53.977072 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:53.976724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:05:53.996211 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:53.996164    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" podStartSLOduration=1.154470458 podStartE2EDuration="2.996144208s" totalImagesPullingTime="1.84167375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:05:53.992609366 +0000 UTC m=+865.253738542" watchObservedRunningTime="2026-09-09 16:05:53.996144208 +0000 UTC m=+865.257273384"
Sep 09 16:05:56.996187 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:56.996145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh" event={"ID":"816139fc-4aa6-4afe-9ad4-37008de3b432","Type":"ContainerStarted","Data":"092b0c67c81663cfc488f61f8b4c7727729f1318b977875e6ba1438e17b2c865"}
Sep 09 16:05:56.996760 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:56.996309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:05:57.014306 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:57.014242    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh" podStartSLOduration=2.178114111 podStartE2EDuration="6.014225668s" totalImagesPullingTime="3.836111557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:05:57.011302014 +0000 UTC m=+868.272431190" watchObservedRunningTime="2026-09-09 16:05:57.014225668 +0000 UTC m=+868.275354844"
Sep 09 16:05:59.988429 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:05:59.988399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:06:08.004384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:08.004324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pw6qh"
Sep 09 16:06:33.745225 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.745190    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"]
Sep 09 16:06:33.747830 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.747814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.750810 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.750780    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 16:06:33.750947 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.750829    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 16:06:33.750947 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.750908    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kzfjj\""
Sep 09 16:06:33.752084 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.752063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 16:06:33.758207 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.758186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"]
Sep 09 16:06:33.892822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.892789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9b98b5-eb7e-4c34-8d24-e949306fab49-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.892993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.892839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.892993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.892867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6h7h\" (UniqueName: \"kubernetes.io/projected/7c9b98b5-eb7e-4c34-8d24-e949306fab49-kube-api-access-n6h7h\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.892993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.892921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.892993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.892986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.893149 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.893012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.993751 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.993714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.993926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.993761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.993926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.993793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9b98b5-eb7e-4c34-8d24-e949306fab49-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.993926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.993837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.993926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.993867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6h7h\" (UniqueName: \"kubernetes.io/projected/7c9b98b5-eb7e-4c34-8d24-e949306fab49-kube-api-access-n6h7h\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.993926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.993904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.994402 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.994372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.994402 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.994391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.994574 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.994453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.996586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.996522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9b98b5-eb7e-4c34-8d24-e949306fab49-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:33.996696 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:33.996598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9b98b5-eb7e-4c34-8d24-e949306fab49-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:34.002231 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:34.002210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6h7h\" (UniqueName: \"kubernetes.io/projected/7c9b98b5-eb7e-4c34-8d24-e949306fab49-kube-api-access-n6h7h\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk\" (UID: \"7c9b98b5-eb7e-4c34-8d24-e949306fab49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:34.058438 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:34.058404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:34.331055 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:34.331029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"]
Sep 09 16:06:34.332735 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:06:34.332706    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9b98b5_eb7e_4c34_8d24_e949306fab49.slice/crio-b5cfbf3cf223b8f7446157cf0623d5cd7a76f8e88b292999bbc0ae32702cb103 WatchSource:0}: Error finding container b5cfbf3cf223b8f7446157cf0623d5cd7a76f8e88b292999bbc0ae32702cb103: Status 404 returned error can't find the container with id b5cfbf3cf223b8f7446157cf0623d5cd7a76f8e88b292999bbc0ae32702cb103
Sep 09 16:06:35.209799 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:35.209756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk" event={"ID":"7c9b98b5-eb7e-4c34-8d24-e949306fab49","Type":"ContainerStarted","Data":"b5cfbf3cf223b8f7446157cf0623d5cd7a76f8e88b292999bbc0ae32702cb103"}
Sep 09 16:06:36.217840 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:36.217795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk" event={"ID":"7c9b98b5-eb7e-4c34-8d24-e949306fab49","Type":"ContainerStarted","Data":"f8ca42663daa76bbebbef97b059434c5f876e4f93516f2eea785f511aa9e4e57"}
Sep 09 16:06:36.236987 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:36.236940    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk" podStartSLOduration=2.234156016 podStartE2EDuration="3.236924963s" totalImagesPullingTime="1.002768947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:06:36.235886467 +0000 UTC m=+907.497015643" watchObservedRunningTime="2026-09-09 16:06:36.236924963 +0000 UTC m=+907.498054138"
Sep 09 16:06:44.059326 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:44.059289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:44.059722 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:44.059380    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:44.071519 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:44.071501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:06:44.271563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:06:44.271530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk"
Sep 09 16:07:16.846111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.846066    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"]
Sep 09 16:07:16.850439 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.850417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:16.853100 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.853081    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 16:07:16.860166 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.860145    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"]
Sep 09 16:07:16.947553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.947527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53c83cc9-f6ed-43dd-b9bd-076101be028c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:16.947664 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.947558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:16.947664 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.947579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccjsg\" (UniqueName: \"kubernetes.io/projected/53c83cc9-f6ed-43dd-b9bd-076101be028c-kube-api-access-ccjsg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:16.947664 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.947643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:16.947772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.947670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:16.947772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:16.947726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.048913 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.048888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.048931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53c83cc9-f6ed-43dd-b9bd-076101be028c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.048952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.048977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccjsg\" (UniqueName: \"kubernetes.io/projected/53c83cc9-f6ed-43dd-b9bd-076101be028c-kube-api-access-ccjsg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.049026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.049071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.049452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.049475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.049660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.049492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.051177 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.051153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53c83cc9-f6ed-43dd-b9bd-076101be028c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.051696 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.051677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53c83cc9-f6ed-43dd-b9bd-076101be028c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.056639 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.056613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccjsg\" (UniqueName: \"kubernetes.io/projected/53c83cc9-f6ed-43dd-b9bd-076101be028c-kube-api-access-ccjsg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dp2z8\" (UID: \"53c83cc9-f6ed-43dd-b9bd-076101be028c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.161200 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.161141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:17.433240 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.433212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"]
Sep 09 16:07:17.434806 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:07:17.434781    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c83cc9_f6ed_43dd_b9bd_076101be028c.slice/crio-6de9ac09346c173c7e513a4e28e03084e7de72cd5ff9154a242d167b644c754b WatchSource:0}: Error finding container 6de9ac09346c173c7e513a4e28e03084e7de72cd5ff9154a242d167b644c754b: Status 404 returned error can't find the container with id 6de9ac09346c173c7e513a4e28e03084e7de72cd5ff9154a242d167b644c754b
Sep 09 16:07:17.436063 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:17.436045    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:07:18.440100 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:18.440066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8" event={"ID":"53c83cc9-f6ed-43dd-b9bd-076101be028c","Type":"ContainerStarted","Data":"6ec42a9c3b1b45eccec8c8f817447b6c0f567361fe2520f51e6de790872b2fc8"}
Sep 09 16:07:18.440478 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:18.440122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8" event={"ID":"53c83cc9-f6ed-43dd-b9bd-076101be028c","Type":"ContainerStarted","Data":"6de9ac09346c173c7e513a4e28e03084e7de72cd5ff9154a242d167b644c754b"}
Sep 09 16:07:18.458559 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:18.458514    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8" podStartSLOduration=2.247615922 podStartE2EDuration="2.458498274s" totalImagesPullingTime="210.882352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:07:18.456113969 +0000 UTC m=+949.717243154" watchObservedRunningTime="2026-09-09 16:07:18.458498274 +0000 UTC m=+949.719627450"
Sep 09 16:07:27.161768 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:27.161734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:27.162226 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:27.161814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:27.174341 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:27.174320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:07:27.504582 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:07:27.504554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dp2z8"
Sep 09 16:09:12.136649 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.136620    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"]
Sep 09 16:09:12.140367 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.140337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.143079 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.143056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7b8369-serving-cert\""
Sep 09 16:09:12.149757 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.149680    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"]
Sep 09 16:09:12.186004 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.185977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64d1a99-d23c-4b8f-8360-d9ae581533b9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.186133 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.186011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzc95\" (UniqueName: \"kubernetes.io/projected/e64d1a99-d23c-4b8f-8360-d9ae581533b9-kube-api-access-nzc95\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.186133 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.186035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.186133 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.186087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-metrics-certs\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.286694 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.286661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64d1a99-d23c-4b8f-8360-d9ae581533b9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.286694 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.286696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzc95\" (UniqueName: \"kubernetes.io/projected/e64d1a99-d23c-4b8f-8360-d9ae581533b9-kube-api-access-nzc95\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.286860 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.286722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.286860 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.286761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-metrics-certs\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.286952 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:09:12.286886    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-serving-cert: secret "maas-api-e2e-inf-a-7b8369-serving-cert" not found
Sep 09 16:09:12.286989 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:09:12.286952    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls podName:e64d1a99-d23c-4b8f-8360-d9ae581533b9 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:12.786935869 +0000 UTC m=+1064.048065027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls") pod "maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" (UID: "e64d1a99-d23c-4b8f-8360-d9ae581533b9") : secret "maas-api-e2e-inf-a-7b8369-serving-cert" not found
Sep 09 16:09:12.287420 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.287405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64d1a99-d23c-4b8f-8360-d9ae581533b9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.289160 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.289132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-metrics-certs\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.296065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.296041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzc95\" (UniqueName: \"kubernetes.io/projected/e64d1a99-d23c-4b8f-8360-d9ae581533b9-kube-api-access-nzc95\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.789818 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.789782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.792171 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.792147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:12.905363 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.905328    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"]
Sep 09 16:09:12.909025 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.909005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:12.911803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.911771    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7b8369\""
Sep 09 16:09:12.911927 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.911830    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7b8369-dockercfg-wcb4x\""
Sep 09 16:09:12.914302 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.914279    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"]
Sep 09 16:09:12.991036 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.991006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67qj\" (UniqueName: \"kubernetes.io/projected/78721d49-abfa-44e5-92ba-af16aeca7415-kube-api-access-q67qj\") pod \"payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:12.991199 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:12.991045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78721d49-abfa-44e5-92ba-af16aeca7415-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:13.053449 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.053380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:13.091773 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.091734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67qj\" (UniqueName: \"kubernetes.io/projected/78721d49-abfa-44e5-92ba-af16aeca7415-kube-api-access-q67qj\") pod \"payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:13.091944 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.091781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78721d49-abfa-44e5-92ba-af16aeca7415-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:13.092512 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.092488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78721d49-abfa-44e5-92ba-af16aeca7415-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:13.099478 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.099457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67qj\" (UniqueName: \"kubernetes.io/projected/78721d49-abfa-44e5-92ba-af16aeca7415-kube-api-access-q67qj\") pod \"payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:13.221459 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.221429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:13.329419 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.329387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"]
Sep 09 16:09:13.330211 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:09:13.330184    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64d1a99_d23c_4b8f_8360_d9ae581533b9.slice/crio-00815b02429490f4ef5c72d4122575d5b7d49470804acc9ebdea5ad26cec01b2 WatchSource:0}: Error finding container 00815b02429490f4ef5c72d4122575d5b7d49470804acc9ebdea5ad26cec01b2: Status 404 returned error can't find the container with id 00815b02429490f4ef5c72d4122575d5b7d49470804acc9ebdea5ad26cec01b2
Sep 09 16:09:13.496381 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:13.496340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"]
Sep 09 16:09:13.498580 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:09:13.498555    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78721d49_abfa_44e5_92ba_af16aeca7415.slice/crio-ec4ca9dee0c62c061b3aaa133cc75baaeb75a6f7e181d4c5c5bb6357d22c1831 WatchSource:0}: Error finding container ec4ca9dee0c62c061b3aaa133cc75baaeb75a6f7e181d4c5c5bb6357d22c1831: Status 404 returned error can't find the container with id ec4ca9dee0c62c061b3aaa133cc75baaeb75a6f7e181d4c5c5bb6357d22c1831
Sep 09 16:09:14.077597 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.077508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x" event={"ID":"78721d49-abfa-44e5-92ba-af16aeca7415","Type":"ContainerStarted","Data":"197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4"}
Sep 09 16:09:14.077771 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.077599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x" event={"ID":"78721d49-abfa-44e5-92ba-af16aeca7415","Type":"ContainerStarted","Data":"ec4ca9dee0c62c061b3aaa133cc75baaeb75a6f7e181d4c5c5bb6357d22c1831"}
Sep 09 16:09:14.077771 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.077634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:14.079317 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.079285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" event={"ID":"e64d1a99-d23c-4b8f-8360-d9ae581533b9","Type":"ContainerStarted","Data":"cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce"}
Sep 09 16:09:14.079478 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.079334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" event={"ID":"e64d1a99-d23c-4b8f-8360-d9ae581533b9","Type":"ContainerStarted","Data":"00815b02429490f4ef5c72d4122575d5b7d49470804acc9ebdea5ad26cec01b2"}
Sep 09 16:09:14.079478 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.079388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:14.092390 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.092333    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x" podStartSLOduration=2.092319956 podStartE2EDuration="2.092319956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:14.091106869 +0000 UTC m=+1065.352236048" watchObservedRunningTime="2026-09-09 16:09:14.092319956 +0000 UTC m=+1065.353449171"
Sep 09 16:09:14.105396 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:14.105335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" podStartSLOduration=1.636361561 podStartE2EDuration="2.105304442s" totalImagesPullingTime="468.942881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:14.105216828 +0000 UTC m=+1065.366346005" watchObservedRunningTime="2026-09-09 16:09:14.105304442 +0000 UTC m=+1065.366433619"
Sep 09 16:09:20.090552 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.090523    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:09:20.400234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.400150    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"]
Sep 09 16:09:20.404098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.404076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.407466 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.407435    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-083463c6-serving-cert\""
Sep 09 16:09:20.418455 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.418431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"]
Sep 09 16:09:20.462033 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.462006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvd9g\" (UniqueName: \"kubernetes.io/projected/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-kube-api-access-gvd9g\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.462160 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.462133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.462160 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.462157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-openshift-service-ca\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.462286 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.462235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-metrics-certs\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.563535 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.563498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-metrics-certs\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.563677 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.563543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvd9g\" (UniqueName: \"kubernetes.io/projected/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-kube-api-access-gvd9g\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.563677 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.563619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.563677 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.563638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-openshift-service-ca\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.563908 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:09:20.563750    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-serving-cert: secret "maas-api-e2e-ait-083463c6-serving-cert" not found
Sep 09 16:09:20.563908 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:09:20.563832    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls podName:c2d7908f-b4fa-4933-a44c-1daaa533a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:21.063808103 +0000 UTC m=+1072.324937268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls") pod "maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" (UID: "c2d7908f-b4fa-4933-a44c-1daaa533a3a2") : secret "maas-api-e2e-ait-083463c6-serving-cert" not found
Sep 09 16:09:20.564310 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.564292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-openshift-service-ca\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.565981 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.565962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-metrics-certs\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:20.581631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:20.581611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvd9g\" (UniqueName: \"kubernetes.io/projected/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-kube-api-access-gvd9g\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:21.069116 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.069045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:21.071317 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.071293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls\") pod \"maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:21.315735 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.315701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:21.531395 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.531344    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"]
Sep 09 16:09:21.536478 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.536456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.538921 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.538900    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-a09c2a-serving-cert\""
Sep 09 16:09:21.543450 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.543429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"]
Sep 09 16:09:21.587866 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.587842    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"]
Sep 09 16:09:21.590528 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:09:21.590503    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d7908f_b4fa_4933_a44c_1daaa533a3a2.slice/crio-175bbd686f9162b84bd05c64d84cbbb9fc7b79b8c9ec886cc7f0d4b648264604 WatchSource:0}: Error finding container 175bbd686f9162b84bd05c64d84cbbb9fc7b79b8c9ec886cc7f0d4b648264604: Status 404 returned error can't find the container with id 175bbd686f9162b84bd05c64d84cbbb9fc7b79b8c9ec886cc7f0d4b648264604
Sep 09 16:09:21.674105 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.674070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb4551-48fe-4635-a590-83248e7948be-openshift-service-ca\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.674234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.674117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-maas-api-tls\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.674234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.674172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-metrics-certs\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.674234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.674209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmnjl\" (UniqueName: \"kubernetes.io/projected/e9bb4551-48fe-4635-a590-83248e7948be-kube-api-access-kmnjl\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.774713 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.774686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-metrics-certs\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.774848 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.774727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmnjl\" (UniqueName: \"kubernetes.io/projected/e9bb4551-48fe-4635-a590-83248e7948be-kube-api-access-kmnjl\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.774896 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.774852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb4551-48fe-4635-a590-83248e7948be-openshift-service-ca\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.774943 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.774912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-maas-api-tls\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.775656 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.775630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb4551-48fe-4635-a590-83248e7948be-openshift-service-ca\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.777189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.777159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-metrics-certs\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.777269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.777258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-maas-api-tls\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.783173 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.783150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmnjl\" (UniqueName: \"kubernetes.io/projected/e9bb4551-48fe-4635-a590-83248e7948be-kube-api-access-kmnjl\") pod \"maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:21.849376 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:21.849297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:22.129238 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:22.129189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" event={"ID":"c2d7908f-b4fa-4933-a44c-1daaa533a3a2","Type":"ContainerStarted","Data":"175bbd686f9162b84bd05c64d84cbbb9fc7b79b8c9ec886cc7f0d4b648264604"}
Sep 09 16:09:22.130336 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:22.130309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"]
Sep 09 16:09:22.131273 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:09:22.131246    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bb4551_48fe_4635_a590_83248e7948be.slice/crio-adbfc00815a3172494f72a7e1c9c53f4f6b2919896cabe9dbfad1fa133488feb WatchSource:0}: Error finding container adbfc00815a3172494f72a7e1c9c53f4f6b2919896cabe9dbfad1fa133488feb: Status 404 returned error can't find the container with id adbfc00815a3172494f72a7e1c9c53f4f6b2919896cabe9dbfad1fa133488feb
Sep 09 16:09:23.136263 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.136220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" event={"ID":"c2d7908f-b4fa-4933-a44c-1daaa533a3a2","Type":"ContainerStarted","Data":"bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943"}
Sep 09 16:09:23.136757 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.136400    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:23.138001 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.137973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" event={"ID":"e9bb4551-48fe-4635-a590-83248e7948be","Type":"ContainerStarted","Data":"f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8"}
Sep 09 16:09:23.138108 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.138024    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:23.138108 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.138045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" event={"ID":"e9bb4551-48fe-4635-a590-83248e7948be","Type":"ContainerStarted","Data":"adbfc00815a3172494f72a7e1c9c53f4f6b2919896cabe9dbfad1fa133488feb"}
Sep 09 16:09:23.157373 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.157319    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" podStartSLOduration=2.6258927930000002 podStartE2EDuration="3.15730588s" totalImagesPullingTime="531.413087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:23.154527066 +0000 UTC m=+1074.415656250" watchObservedRunningTime="2026-09-09 16:09:23.15730588 +0000 UTC m=+1074.418435056"
Sep 09 16:09:23.174274 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:23.174225    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" podStartSLOduration=1.815500879 podStartE2EDuration="2.174212063s" totalImagesPullingTime="358.711184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:23.171323169 +0000 UTC m=+1074.432452422" watchObservedRunningTime="2026-09-09 16:09:23.174212063 +0000 UTC m=+1074.435341239"
Sep 09 16:09:25.086878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:25.086851    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:09:29.149047 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:29.149018    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:09:29.149599 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:29.149582    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:09:41.122721 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.122690    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"]
Sep 09 16:09:41.127788 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.127764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.130144 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.130121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c23ff1-serving-cert\""
Sep 09 16:09:41.135508 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.135387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"]
Sep 09 16:09:41.254604 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.254571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.254604 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.254609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-metrics-certs\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.254811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.254661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ec3b62-5f0f-4921-940f-b3951190f307-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.254811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.254678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5d2h\" (UniqueName: \"kubernetes.io/projected/f8ec3b62-5f0f-4921-940f-b3951190f307-kube-api-access-r5d2h\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.355807 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.355776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.355807 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.355809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-metrics-certs\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.356042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.355842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ec3b62-5f0f-4921-940f-b3951190f307-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.356042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.355860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5d2h\" (UniqueName: \"kubernetes.io/projected/f8ec3b62-5f0f-4921-940f-b3951190f307-kube-api-access-r5d2h\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.356042 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:09:41.355922    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-serving-cert: secret "maas-api-e2e-inf-b-c23ff1-serving-cert" not found
Sep 09 16:09:41.356042 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:09:41.355985    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls podName:f8ec3b62-5f0f-4921-940f-b3951190f307 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:41.855968565 +0000 UTC m=+1093.117097722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls") pod "maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" (UID: "f8ec3b62-5f0f-4921-940f-b3951190f307") : secret "maas-api-e2e-inf-b-c23ff1-serving-cert" not found
Sep 09 16:09:41.356467 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.356445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ec3b62-5f0f-4921-940f-b3951190f307-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.358361 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.358330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-metrics-certs\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.374328 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.374266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5d2h\" (UniqueName: \"kubernetes.io/projected/f8ec3b62-5f0f-4921-940f-b3951190f307-kube-api-access-r5d2h\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.860817 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.860782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:41.863056 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:41.863038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:42.040776 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:42.040740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:42.324812 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:42.324787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"]
Sep 09 16:09:42.326468 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:09:42.326440    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ec3b62_5f0f_4921_940f_b3951190f307.slice/crio-d31a00c3be3c0dc6e3f2228ef33305be3a3c33c8d9d52bd656a375e09c1adb37 WatchSource:0}: Error finding container d31a00c3be3c0dc6e3f2228ef33305be3a3c33c8d9d52bd656a375e09c1adb37: Status 404 returned error can't find the container with id d31a00c3be3c0dc6e3f2228ef33305be3a3c33c8d9d52bd656a375e09c1adb37
Sep 09 16:09:43.261771 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:43.261733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" event={"ID":"f8ec3b62-5f0f-4921-940f-b3951190f307","Type":"ContainerStarted","Data":"bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88"}
Sep 09 16:09:43.261949 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:43.261832    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:09:43.261949 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:43.261856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" event={"ID":"f8ec3b62-5f0f-4921-940f-b3951190f307","Type":"ContainerStarted","Data":"d31a00c3be3c0dc6e3f2228ef33305be3a3c33c8d9d52bd656a375e09c1adb37"}
Sep 09 16:09:43.280334 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:43.280277    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" podStartSLOduration=1.861475642 podStartE2EDuration="2.280261674s" totalImagesPullingTime="418.786032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:43.277971335 +0000 UTC m=+1094.539100522" watchObservedRunningTime="2026-09-09 16:09:43.280261674 +0000 UTC m=+1094.541390861"
Sep 09 16:09:49.273759 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:09:49.273732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:10:00.963384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:00.963331    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"]
Sep 09 16:10:00.963775 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:00.963599    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" podUID="c2d7908f-b4fa-4933-a44c-1daaa533a3a2" containerName="maas-api" containerID="cri-o://bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943" gracePeriod=30
Sep 09 16:10:01.217332 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.217277    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:10:01.321259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.321226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls\") pod \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") "
Sep 09 16:10:01.321450 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.321339    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-metrics-certs\") pod \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") "
Sep 09 16:10:01.321450 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.321425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvd9g\" (UniqueName: \"kubernetes.io/projected/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-kube-api-access-gvd9g\") pod \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") "
Sep 09 16:10:01.321600 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.321498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-openshift-service-ca\") pod \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\" (UID: \"c2d7908f-b4fa-4933-a44c-1daaa533a3a2\") "
Sep 09 16:10:01.322929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.322035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c2d7908f-b4fa-4933-a44c-1daaa533a3a2" (UID: "c2d7908f-b4fa-4933-a44c-1daaa533a3a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:10:01.324406 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.324381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c2d7908f-b4fa-4933-a44c-1daaa533a3a2" (UID: "c2d7908f-b4fa-4933-a44c-1daaa533a3a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:10:01.325217 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.325184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-kube-api-access-gvd9g" (OuterVolumeSpecName: "kube-api-access-gvd9g") pod "c2d7908f-b4fa-4933-a44c-1daaa533a3a2" (UID: "c2d7908f-b4fa-4933-a44c-1daaa533a3a2"). InnerVolumeSpecName "kube-api-access-gvd9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:10:01.325217 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.325208    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c2d7908f-b4fa-4933-a44c-1daaa533a3a2" (UID: "c2d7908f-b4fa-4933-a44c-1daaa533a3a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:10:01.372558 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.372530    2578 generic.go:356] "Generic (PLEG): container finished" podID="c2d7908f-b4fa-4933-a44c-1daaa533a3a2" containerID="bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943" exitCode=0
Sep 09 16:10:01.372711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.372578    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"
Sep 09 16:10:01.372711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.372623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" event={"ID":"c2d7908f-b4fa-4933-a44c-1daaa533a3a2","Type":"ContainerDied","Data":"bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943"}
Sep 09 16:10:01.372711 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.372696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6" event={"ID":"c2d7908f-b4fa-4933-a44c-1daaa533a3a2","Type":"ContainerDied","Data":"175bbd686f9162b84bd05c64d84cbbb9fc7b79b8c9ec886cc7f0d4b648264604"}
Sep 09 16:10:01.372875 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.372720    2578 scope.go:117] "RemoveContainer" containerID="bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943"
Sep 09 16:10:01.385276 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.385254    2578 scope.go:117] "RemoveContainer" containerID="bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943"
Sep 09 16:10:01.385631 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:10:01.385610    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943\": container with ID starting with bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943 not found: ID does not exist" containerID="bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943"
Sep 09 16:10:01.385721 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.385640    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943"} err="failed to get container status \"bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943\": rpc error: code = NotFound desc = could not find container \"bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943\": container with ID starting with bbe5b4f6fd50934f728d65a8caaaf1015d2607df785340822297a510cc71b943 not found: ID does not exist"
Sep 09 16:10:01.398954 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.398930    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"]
Sep 09 16:10:01.405291 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.405216    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083463c6-5746dd68c5-6t8p6"]
Sep 09 16:10:01.422469 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.422438    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:01.422469 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.422460    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvd9g\" (UniqueName: \"kubernetes.io/projected/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-kube-api-access-gvd9g\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:01.422469 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.422470    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:01.422941 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:01.422480    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2d7908f-b4fa-4933-a44c-1daaa533a3a2-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:03.368370 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:03.368332    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d7908f-b4fa-4933-a44c-1daaa533a3a2" path="/var/lib/kubelet/pods/c2d7908f-b4fa-4933-a44c-1daaa533a3a2/volumes"
Sep 09 16:10:04.826133 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.826097    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"]
Sep 09 16:10:04.826661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.826643    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d7908f-b4fa-4933-a44c-1daaa533a3a2" containerName="maas-api"
Sep 09 16:10:04.826708 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.826664    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d7908f-b4fa-4933-a44c-1daaa533a3a2" containerName="maas-api"
Sep 09 16:10:04.826748 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.826742    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d7908f-b4fa-4933-a44c-1daaa533a3a2" containerName="maas-api"
Sep 09 16:10:04.831305 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.831282    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:04.833757 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.833735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dae90c4d-serving-cert\""
Sep 09 16:10:04.842254 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.842228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"]
Sep 09 16:10:04.955403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.955368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/199ef967-af63-4c6d-a6fe-9be73275f51e-openshift-service-ca\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:04.955557 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.955452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-metrics-certs\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:04.955557 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.955505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-maas-api-tls\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:04.955653 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:04.955589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nwt\" (UniqueName: \"kubernetes.io/projected/199ef967-af63-4c6d-a6fe-9be73275f51e-kube-api-access-w9nwt\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.056647 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.056621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/199ef967-af63-4c6d-a6fe-9be73275f51e-openshift-service-ca\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.056808 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.056666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-metrics-certs\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.056808 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.056706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-maas-api-tls\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.056808 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.056769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nwt\" (UniqueName: \"kubernetes.io/projected/199ef967-af63-4c6d-a6fe-9be73275f51e-kube-api-access-w9nwt\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.057375 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.057328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/199ef967-af63-4c6d-a6fe-9be73275f51e-openshift-service-ca\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.059053 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.059031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-maas-api-tls\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.059145 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.059101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-metrics-certs\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.064303 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.064284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nwt\" (UniqueName: \"kubernetes.io/projected/199ef967-af63-4c6d-a6fe-9be73275f51e-kube-api-access-w9nwt\") pod \"maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.144121 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.144062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:05.424037 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:05.423997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"]
Sep 09 16:10:05.426953 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:10:05.426919    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199ef967_af63_4c6d_a6fe_9be73275f51e.slice/crio-9acb574319757719c30480a39046d22a8eb52ae0689b29fdc299cf4070c8abe1 WatchSource:0}: Error finding container 9acb574319757719c30480a39046d22a8eb52ae0689b29fdc299cf4070c8abe1: Status 404 returned error can't find the container with id 9acb574319757719c30480a39046d22a8eb52ae0689b29fdc299cf4070c8abe1
Sep 09 16:10:06.405808 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:06.405770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx" event={"ID":"199ef967-af63-4c6d-a6fe-9be73275f51e","Type":"ContainerStarted","Data":"184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc"}
Sep 09 16:10:06.406249 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:06.405818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx" event={"ID":"199ef967-af63-4c6d-a6fe-9be73275f51e","Type":"ContainerStarted","Data":"9acb574319757719c30480a39046d22a8eb52ae0689b29fdc299cf4070c8abe1"}
Sep 09 16:10:06.406249 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:06.405898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:06.424087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:06.424041    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx" podStartSLOduration=2.028037313 podStartE2EDuration="2.424026083s" totalImagesPullingTime="395.98877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:10:06.421902153 +0000 UTC m=+1117.683031331" watchObservedRunningTime="2026-09-09 16:10:06.424026083 +0000 UTC m=+1117.685155258"
Sep 09 16:10:12.416758 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:12.416723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:36.240205 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.240170    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"]
Sep 09 16:10:36.240703 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.240408    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx" podUID="199ef967-af63-4c6d-a6fe-9be73275f51e" containerName="maas-api" containerID="cri-o://184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc" gracePeriod=30
Sep 09 16:10:36.490815 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.490758    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:36.529216 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.529189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/199ef967-af63-4c6d-a6fe-9be73275f51e-openshift-service-ca\") pod \"199ef967-af63-4c6d-a6fe-9be73275f51e\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") "
Sep 09 16:10:36.529384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.529221    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-metrics-certs\") pod \"199ef967-af63-4c6d-a6fe-9be73275f51e\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") "
Sep 09 16:10:36.529384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.529237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-maas-api-tls\") pod \"199ef967-af63-4c6d-a6fe-9be73275f51e\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") "
Sep 09 16:10:36.529384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.529262    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9nwt\" (UniqueName: \"kubernetes.io/projected/199ef967-af63-4c6d-a6fe-9be73275f51e-kube-api-access-w9nwt\") pod \"199ef967-af63-4c6d-a6fe-9be73275f51e\" (UID: \"199ef967-af63-4c6d-a6fe-9be73275f51e\") "
Sep 09 16:10:36.529571 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.529521    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199ef967-af63-4c6d-a6fe-9be73275f51e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "199ef967-af63-4c6d-a6fe-9be73275f51e" (UID: "199ef967-af63-4c6d-a6fe-9be73275f51e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:10:36.529699 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.529678    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/199ef967-af63-4c6d-a6fe-9be73275f51e-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:36.531386 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.531326    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "199ef967-af63-4c6d-a6fe-9be73275f51e" (UID: "199ef967-af63-4c6d-a6fe-9be73275f51e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:10:36.531386 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.531372    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199ef967-af63-4c6d-a6fe-9be73275f51e-kube-api-access-w9nwt" (OuterVolumeSpecName: "kube-api-access-w9nwt") pod "199ef967-af63-4c6d-a6fe-9be73275f51e" (UID: "199ef967-af63-4c6d-a6fe-9be73275f51e"). InnerVolumeSpecName "kube-api-access-w9nwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:10:36.531643 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.531626    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "199ef967-af63-4c6d-a6fe-9be73275f51e" (UID: "199ef967-af63-4c6d-a6fe-9be73275f51e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:10:36.579520 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.579326    2578 generic.go:356] "Generic (PLEG): container finished" podID="199ef967-af63-4c6d-a6fe-9be73275f51e" containerID="184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc" exitCode=0
Sep 09 16:10:36.579520 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.579405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx" event={"ID":"199ef967-af63-4c6d-a6fe-9be73275f51e","Type":"ContainerDied","Data":"184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc"}
Sep 09 16:10:36.579520 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.579481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx" event={"ID":"199ef967-af63-4c6d-a6fe-9be73275f51e","Type":"ContainerDied","Data":"9acb574319757719c30480a39046d22a8eb52ae0689b29fdc299cf4070c8abe1"}
Sep 09 16:10:36.579520 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.579508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"
Sep 09 16:10:36.579887 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.579511    2578 scope.go:117] "RemoveContainer" containerID="184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc"
Sep 09 16:10:36.601514 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.601391    2578 scope.go:117] "RemoveContainer" containerID="184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc"
Sep 09 16:10:36.601751 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:10:36.601725    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc\": container with ID starting with 184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc not found: ID does not exist" containerID="184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc"
Sep 09 16:10:36.601835 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.601760    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc"} err="failed to get container status \"184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc\": rpc error: code = NotFound desc = could not find container \"184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc\": container with ID starting with 184ae8c9e70a4b30f57a2b9fa24e3f3970b0903253ade0327d9f48817aed0cdc not found: ID does not exist"
Sep 09 16:10:36.614954 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.614929    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"]
Sep 09 16:10:36.620067 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.620045    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dae90c4d-56bc5cff7-5kqhx"]
Sep 09 16:10:36.630617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.630600    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:36.630617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.630618    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/199ef967-af63-4c6d-a6fe-9be73275f51e-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:36.630726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:36.630627    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9nwt\" (UniqueName: \"kubernetes.io/projected/199ef967-af63-4c6d-a6fe-9be73275f51e-kube-api-access-w9nwt\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:10:37.369757 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:37.369723    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="199ef967-af63-4c6d-a6fe-9be73275f51e" path="/var/lib/kubelet/pods/199ef967-af63-4c6d-a6fe-9be73275f51e/volumes"
Sep 09 16:10:41.018252 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.018196    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"]
Sep 09 16:10:41.018908 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.018885    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199ef967-af63-4c6d-a6fe-9be73275f51e" containerName="maas-api"
Sep 09 16:10:41.018957 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.018913    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="199ef967-af63-4c6d-a6fe-9be73275f51e" containerName="maas-api"
Sep 09 16:10:41.019043 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.019031    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="199ef967-af63-4c6d-a6fe-9be73275f51e" containerName="maas-api"
Sep 09 16:10:41.024066 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.024045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.026403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.026387    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-58050ce1-serving-cert\""
Sep 09 16:10:41.031369 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.031325    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"]
Sep 09 16:10:41.066551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.066511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.066670 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.066634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/31f7d273-9504-4e37-bca2-e1a912c99a6f-kube-api-access-xcn2x\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.066741 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.066672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-metrics-certs\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.066741 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.066716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31f7d273-9504-4e37-bca2-e1a912c99a6f-openshift-service-ca\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.167238 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.167201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.167436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.167288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/31f7d273-9504-4e37-bca2-e1a912c99a6f-kube-api-access-xcn2x\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.167436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.167325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-metrics-certs\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.167436 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:10:41.167374    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-serving-cert: secret "maas-api-e2e-ait-58050ce1-serving-cert" not found
Sep 09 16:10:41.167436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.167399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31f7d273-9504-4e37-bca2-e1a912c99a6f-openshift-service-ca\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.167665 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:10:41.167454    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls podName:31f7d273-9504-4e37-bca2-e1a912c99a6f nodeName:}" failed. No retries permitted until 2026-09-09 16:10:41.667436355 +0000 UTC m=+1152.928565522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls") pod "maas-api-e2e-ait-58050ce1-56f9899975-dgshn" (UID: "31f7d273-9504-4e37-bca2-e1a912c99a6f") : secret "maas-api-e2e-ait-58050ce1-serving-cert" not found
Sep 09 16:10:41.168081 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.168059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31f7d273-9504-4e37-bca2-e1a912c99a6f-openshift-service-ca\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.169752 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.169730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-metrics-certs\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.177581 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.177561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/31f7d273-9504-4e37-bca2-e1a912c99a6f-kube-api-access-xcn2x\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.671220 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.671190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.673726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.673703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls\") pod \"maas-api-e2e-ait-58050ce1-56f9899975-dgshn\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:41.937959 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:41.937869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:42.220281 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:42.220256    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"]
Sep 09 16:10:42.222502 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:10:42.222468    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f7d273_9504_4e37_bca2_e1a912c99a6f.slice/crio-5303c7e7db11c13b60b216c2a85c1ba23f26dadf58df849fdde0ddb471b81da1 WatchSource:0}: Error finding container 5303c7e7db11c13b60b216c2a85c1ba23f26dadf58df849fdde0ddb471b81da1: Status 404 returned error can't find the container with id 5303c7e7db11c13b60b216c2a85c1ba23f26dadf58df849fdde0ddb471b81da1
Sep 09 16:10:42.617763 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:42.617683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn" event={"ID":"31f7d273-9504-4e37-bca2-e1a912c99a6f","Type":"ContainerStarted","Data":"5303c7e7db11c13b60b216c2a85c1ba23f26dadf58df849fdde0ddb471b81da1"}
Sep 09 16:10:43.625911 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:43.625863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn" event={"ID":"31f7d273-9504-4e37-bca2-e1a912c99a6f","Type":"ContainerStarted","Data":"ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a"}
Sep 09 16:10:43.626366 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:43.626019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:10:43.644878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:43.644829    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn" podStartSLOduration=1.8605228409999999 podStartE2EDuration="2.644815061s" totalImagesPullingTime="784.29222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:10:43.643179238 +0000 UTC m=+1154.904308414" watchObservedRunningTime="2026-09-09 16:10:43.644815061 +0000 UTC m=+1154.905944237"
Sep 09 16:10:49.637852 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:10:49.637823    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:11:11.772414 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:11.772375    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"]
Sep 09 16:11:11.773000 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:11.772609    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn" podUID="31f7d273-9504-4e37-bca2-e1a912c99a6f" containerName="maas-api" containerID="cri-o://ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a" gracePeriod=30
Sep 09 16:11:12.029278 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.029218    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:11:12.136644 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.136604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31f7d273-9504-4e37-bca2-e1a912c99a6f-openshift-service-ca\") pod \"31f7d273-9504-4e37-bca2-e1a912c99a6f\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") "
Sep 09 16:11:12.136786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.136720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-metrics-certs\") pod \"31f7d273-9504-4e37-bca2-e1a912c99a6f\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") "
Sep 09 16:11:12.136786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.136763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/31f7d273-9504-4e37-bca2-e1a912c99a6f-kube-api-access-xcn2x\") pod \"31f7d273-9504-4e37-bca2-e1a912c99a6f\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") "
Sep 09 16:11:12.136882 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.136803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls\") pod \"31f7d273-9504-4e37-bca2-e1a912c99a6f\" (UID: \"31f7d273-9504-4e37-bca2-e1a912c99a6f\") "
Sep 09 16:11:12.136946 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.136898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f7d273-9504-4e37-bca2-e1a912c99a6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31f7d273-9504-4e37-bca2-e1a912c99a6f" (UID: "31f7d273-9504-4e37-bca2-e1a912c99a6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:11:12.137165 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.137142    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31f7d273-9504-4e37-bca2-e1a912c99a6f-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:12.138770 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.138735    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31f7d273-9504-4e37-bca2-e1a912c99a6f" (UID: "31f7d273-9504-4e37-bca2-e1a912c99a6f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:11:12.138876 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.138788    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f7d273-9504-4e37-bca2-e1a912c99a6f-kube-api-access-xcn2x" (OuterVolumeSpecName: "kube-api-access-xcn2x") pod "31f7d273-9504-4e37-bca2-e1a912c99a6f" (UID: "31f7d273-9504-4e37-bca2-e1a912c99a6f"). InnerVolumeSpecName "kube-api-access-xcn2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:11:12.138876 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.138790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31f7d273-9504-4e37-bca2-e1a912c99a6f" (UID: "31f7d273-9504-4e37-bca2-e1a912c99a6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:11:12.238616 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.238589    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:12.238616 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.238613    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/31f7d273-9504-4e37-bca2-e1a912c99a6f-kube-api-access-xcn2x\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:12.238616 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.238622    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31f7d273-9504-4e37-bca2-e1a912c99a6f-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:12.800912 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.800874    2578 generic.go:356] "Generic (PLEG): container finished" podID="31f7d273-9504-4e37-bca2-e1a912c99a6f" containerID="ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a" exitCode=0
Sep 09 16:11:12.801340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.800918    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"
Sep 09 16:11:12.801340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.800922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn" event={"ID":"31f7d273-9504-4e37-bca2-e1a912c99a6f","Type":"ContainerDied","Data":"ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a"}
Sep 09 16:11:12.801340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.801022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn" event={"ID":"31f7d273-9504-4e37-bca2-e1a912c99a6f","Type":"ContainerDied","Data":"5303c7e7db11c13b60b216c2a85c1ba23f26dadf58df849fdde0ddb471b81da1"}
Sep 09 16:11:12.801340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.801048    2578 scope.go:117] "RemoveContainer" containerID="ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a"
Sep 09 16:11:12.810863 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.810840    2578 scope.go:117] "RemoveContainer" containerID="ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a"
Sep 09 16:11:12.811140 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:11:12.811120    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a\": container with ID starting with ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a not found: ID does not exist" containerID="ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a"
Sep 09 16:11:12.811187 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.811149    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a"} err="failed to get container status \"ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a\": rpc error: code = NotFound desc = could not find container \"ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a\": container with ID starting with ddc9a256bb2bc62be10792bb35d9b11ef22479099a1e7f46d2ba2a710311881a not found: ID does not exist"
Sep 09 16:11:12.824181 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.824156    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"]
Sep 09 16:11:12.828568 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:12.828549    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-58050ce1-56f9899975-dgshn"]
Sep 09 16:11:13.368199 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:13.368159    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31f7d273-9504-4e37-bca2-e1a912c99a6f" path="/var/lib/kubelet/pods/31f7d273-9504-4e37-bca2-e1a912c99a6f/volumes"
Sep 09 16:11:18.238772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.238730    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"]
Sep 09 16:11:18.239260 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.239244    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f7d273-9504-4e37-bca2-e1a912c99a6f" containerName="maas-api"
Sep 09 16:11:18.239325 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.239262    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f7d273-9504-4e37-bca2-e1a912c99a6f" containerName="maas-api"
Sep 09 16:11:18.239393 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.239325    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f7d273-9504-4e37-bca2-e1a912c99a6f" containerName="maas-api"
Sep 09 16:11:18.243763 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.243743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.246498 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.246479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f772da8e-serving-cert\""
Sep 09 16:11:18.256722 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.256702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"]
Sep 09 16:11:18.399269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.399235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d25e3e-1704-41ef-bebf-8e3668ca5030-openshift-service-ca\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.399476 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.399308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smm54\" (UniqueName: \"kubernetes.io/projected/f0d25e3e-1704-41ef-bebf-8e3668ca5030-kube-api-access-smm54\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.399476 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.399399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-metrics-certs\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.399476 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.399436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.500897 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.500812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d25e3e-1704-41ef-bebf-8e3668ca5030-openshift-service-ca\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.501045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.500899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smm54\" (UniqueName: \"kubernetes.io/projected/f0d25e3e-1704-41ef-bebf-8e3668ca5030-kube-api-access-smm54\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.501045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.500960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-metrics-certs\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.501045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.500990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.501217 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:11:18.501115    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-serving-cert: secret "maas-api-e2e-derive-f772da8e-serving-cert" not found
Sep 09 16:11:18.501217 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:11:18.501178    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls podName:f0d25e3e-1704-41ef-bebf-8e3668ca5030 nodeName:}" failed. No retries permitted until 2026-09-09 16:11:19.001156794 +0000 UTC m=+1190.262285965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls") pod "maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" (UID: "f0d25e3e-1704-41ef-bebf-8e3668ca5030") : secret "maas-api-e2e-derive-f772da8e-serving-cert" not found
Sep 09 16:11:18.501634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.501616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d25e3e-1704-41ef-bebf-8e3668ca5030-openshift-service-ca\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.503451 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.503430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-metrics-certs\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:18.514086 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:18.514058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smm54\" (UniqueName: \"kubernetes.io/projected/f0d25e3e-1704-41ef-bebf-8e3668ca5030-kube-api-access-smm54\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:19.005960 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.005926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:19.008269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.008241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls\") pod \"maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:19.019990 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.019964    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"]
Sep 09 16:11:19.023691 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.023675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.027341 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.027321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f772da8e-dockercfg-6f95f\""
Sep 09 16:11:19.027341 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.027330    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f772da8e\""
Sep 09 16:11:19.040511 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.040487    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"]
Sep 09 16:11:19.106756 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.106720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0613b133-92d5-43b8-9128-cc7c23e1a6ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.106936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.106780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnzz\" (UniqueName: \"kubernetes.io/projected/0613b133-92d5-43b8-9128-cc7c23e1a6ca-kube-api-access-qtnzz\") pod \"payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.154050 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.154022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:19.208805 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.208637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0613b133-92d5-43b8-9128-cc7c23e1a6ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.208805 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.208733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnzz\" (UniqueName: \"kubernetes.io/projected/0613b133-92d5-43b8-9128-cc7c23e1a6ca-kube-api-access-qtnzz\") pod \"payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.210009 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.209938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0613b133-92d5-43b8-9128-cc7c23e1a6ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.221634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.221603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnzz\" (UniqueName: \"kubernetes.io/projected/0613b133-92d5-43b8-9128-cc7c23e1a6ca-kube-api-access-qtnzz\") pod \"payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.334158 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.334089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.430942 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:11:19.430910    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d25e3e_1704_41ef_bebf_8e3668ca5030.slice/crio-1ad6134ff499089ea36ebce45bfb26b5de5e3fedfd1a67da64e4bd49b62a031f WatchSource:0}: Error finding container 1ad6134ff499089ea36ebce45bfb26b5de5e3fedfd1a67da64e4bd49b62a031f: Status 404 returned error can't find the container with id 1ad6134ff499089ea36ebce45bfb26b5de5e3fedfd1a67da64e4bd49b62a031f
Sep 09 16:11:19.431519 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.431493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"]
Sep 09 16:11:19.613198 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.613172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"]
Sep 09 16:11:19.615099 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:11:19.615071    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0613b133_92d5_43b8_9128_cc7c23e1a6ca.slice/crio-93a460b8856245d90297041a8a99b1fef8f908537100ce9c35a3da843d46900c WatchSource:0}: Error finding container 93a460b8856245d90297041a8a99b1fef8f908537100ce9c35a3da843d46900c: Status 404 returned error can't find the container with id 93a460b8856245d90297041a8a99b1fef8f908537100ce9c35a3da843d46900c
Sep 09 16:11:19.847940 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.847897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s" event={"ID":"0613b133-92d5-43b8-9128-cc7c23e1a6ca","Type":"ContainerStarted","Data":"c9f0b44161c578009e85d0c6caf7cf3e05391ce77ce6d443df5c1cc6fbfc0ade"}
Sep 09 16:11:19.848137 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.847975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:19.848137 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.848004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s" event={"ID":"0613b133-92d5-43b8-9128-cc7c23e1a6ca","Type":"ContainerStarted","Data":"93a460b8856245d90297041a8a99b1fef8f908537100ce9c35a3da843d46900c"}
Sep 09 16:11:19.849176 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.849153    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" event={"ID":"f0d25e3e-1704-41ef-bebf-8e3668ca5030","Type":"ContainerStarted","Data":"1ad6134ff499089ea36ebce45bfb26b5de5e3fedfd1a67da64e4bd49b62a031f"}
Sep 09 16:11:19.868310 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:19.868235    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s" podStartSLOduration=1.868219205 podStartE2EDuration="1.868219205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:11:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:11:19.865734458 +0000 UTC m=+1191.126863634" watchObservedRunningTime="2026-09-09 16:11:19.868219205 +0000 UTC m=+1191.129348651"
Sep 09 16:11:21.861022 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:21.860988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" event={"ID":"f0d25e3e-1704-41ef-bebf-8e3668ca5030","Type":"ContainerStarted","Data":"f71df7ae1a52d3a7a080ea890ada6e49d86950c233c8e7940d5587eaafd46acc"}
Sep 09 16:11:21.861329 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:21.861050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:21.885803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:21.885749    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" podStartSLOduration=1.6143443880000001 podStartE2EDuration="3.885729971s" totalImagesPullingTime="2.271385583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:11:21.884117375 +0000 UTC m=+1193.145246552" watchObservedRunningTime="2026-09-09 16:11:21.885729971 +0000 UTC m=+1193.146859147"
Sep 09 16:11:27.873168 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:27.873131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:30.857223 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:30.857191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:48.821817 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:48.821775    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"]
Sep 09 16:11:48.824660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:48.822325    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" podUID="f0d25e3e-1704-41ef-bebf-8e3668ca5030" containerName="maas-api" containerID="cri-o://f71df7ae1a52d3a7a080ea890ada6e49d86950c233c8e7940d5587eaafd46acc" gracePeriod=30
Sep 09 16:11:48.881827 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:48.881776    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"]
Sep 09 16:11:48.882116 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:48.882034    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s" podUID="0613b133-92d5-43b8-9128-cc7c23e1a6ca" containerName="payload-pre-processing" containerID="cri-o://c9f0b44161c578009e85d0c6caf7cf3e05391ce77ce6d443df5c1cc6fbfc0ade" gracePeriod=30
Sep 09 16:11:48.967326 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:48.967291    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"]
Sep 09 16:11:48.967613 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:48.967584    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" podUID="e9bb4551-48fe-4635-a590-83248e7948be" containerName="maas-api" containerID="cri-o://f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8" gracePeriod=30
Sep 09 16:11:49.020772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.020734    2578 generic.go:356] "Generic (PLEG): container finished" podID="0613b133-92d5-43b8-9128-cc7c23e1a6ca" containerID="c9f0b44161c578009e85d0c6caf7cf3e05391ce77ce6d443df5c1cc6fbfc0ade" exitCode=0
Sep 09 16:11:49.020945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.020829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s" event={"ID":"0613b133-92d5-43b8-9128-cc7c23e1a6ca","Type":"ContainerDied","Data":"c9f0b44161c578009e85d0c6caf7cf3e05391ce77ce6d443df5c1cc6fbfc0ade"}
Sep 09 16:11:49.025637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.025452    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0d25e3e-1704-41ef-bebf-8e3668ca5030" containerID="f71df7ae1a52d3a7a080ea890ada6e49d86950c233c8e7940d5587eaafd46acc" exitCode=0
Sep 09 16:11:49.025637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.025558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" event={"ID":"f0d25e3e-1704-41ef-bebf-8e3668ca5030","Type":"ContainerDied","Data":"f71df7ae1a52d3a7a080ea890ada6e49d86950c233c8e7940d5587eaafd46acc"}
Sep 09 16:11:49.145496 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.145206    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" podUID="e9bb4551-48fe-4635-a590-83248e7948be" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.56:8443/health\": dial tcp 10.133.0.56:8443: connect: connection refused"
Sep 09 16:11:49.173200 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.173170    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:49.277630 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.277605    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:49.280574 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.280550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d25e3e-1704-41ef-bebf-8e3668ca5030-openshift-service-ca\") pod \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") "
Sep 09 16:11:49.280726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.280580    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smm54\" (UniqueName: \"kubernetes.io/projected/f0d25e3e-1704-41ef-bebf-8e3668ca5030-kube-api-access-smm54\") pod \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") "
Sep 09 16:11:49.280726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.280607    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls\") pod \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") "
Sep 09 16:11:49.280726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.280684    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-metrics-certs\") pod \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\" (UID: \"f0d25e3e-1704-41ef-bebf-8e3668ca5030\") "
Sep 09 16:11:49.281005 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.280964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0d25e3e-1704-41ef-bebf-8e3668ca5030-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0d25e3e-1704-41ef-bebf-8e3668ca5030" (UID: "f0d25e3e-1704-41ef-bebf-8e3668ca5030"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:11:49.282950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.282917    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0d25e3e-1704-41ef-bebf-8e3668ca5030" (UID: "f0d25e3e-1704-41ef-bebf-8e3668ca5030"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:11:49.282950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.282934    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0d25e3e-1704-41ef-bebf-8e3668ca5030" (UID: "f0d25e3e-1704-41ef-bebf-8e3668ca5030"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:11:49.282950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.282937    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0d25e3e-1704-41ef-bebf-8e3668ca5030-kube-api-access-smm54" (OuterVolumeSpecName: "kube-api-access-smm54") pod "f0d25e3e-1704-41ef-bebf-8e3668ca5030" (UID: "f0d25e3e-1704-41ef-bebf-8e3668ca5030"). InnerVolumeSpecName "kube-api-access-smm54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:11:49.293443 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.293425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:11:49.381287 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381264    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb4551-48fe-4635-a590-83248e7948be-openshift-service-ca\") pod \"e9bb4551-48fe-4635-a590-83248e7948be\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") "
Sep 09 16:11:49.381409 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0613b133-92d5-43b8-9128-cc7c23e1a6ca-plugins-config-volume\") pod \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") "
Sep 09 16:11:49.381409 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381329    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-maas-api-tls\") pod \"e9bb4551-48fe-4635-a590-83248e7948be\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") "
Sep 09 16:11:49.381409 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381377    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtnzz\" (UniqueName: \"kubernetes.io/projected/0613b133-92d5-43b8-9128-cc7c23e1a6ca-kube-api-access-qtnzz\") pod \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\" (UID: \"0613b133-92d5-43b8-9128-cc7c23e1a6ca\") "
Sep 09 16:11:49.381553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-metrics-certs\") pod \"e9bb4551-48fe-4635-a590-83248e7948be\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") "
Sep 09 16:11:49.381553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmnjl\" (UniqueName: \"kubernetes.io/projected/e9bb4551-48fe-4635-a590-83248e7948be-kube-api-access-kmnjl\") pod \"e9bb4551-48fe-4635-a590-83248e7948be\" (UID: \"e9bb4551-48fe-4635-a590-83248e7948be\") "
Sep 09 16:11:49.381702 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381674    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9bb4551-48fe-4635-a590-83248e7948be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9bb4551-48fe-4635-a590-83248e7948be" (UID: "e9bb4551-48fe-4635-a590-83248e7948be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:11:49.381772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.381709    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0613b133-92d5-43b8-9128-cc7c23e1a6ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0613b133-92d5-43b8-9128-cc7c23e1a6ca" (UID: "0613b133-92d5-43b8-9128-cc7c23e1a6ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:11:49.382767 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.382738    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb4551-48fe-4635-a590-83248e7948be-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.382891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.382779    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0613b133-92d5-43b8-9128-cc7c23e1a6ca-plugins-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.382891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.382795    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d25e3e-1704-41ef-bebf-8e3668ca5030-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.382891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.382808    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smm54\" (UniqueName: \"kubernetes.io/projected/f0d25e3e-1704-41ef-bebf-8e3668ca5030-kube-api-access-smm54\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.382891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.382822    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.382891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.382834    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d25e3e-1704-41ef-bebf-8e3668ca5030-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.383884 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.383859    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e9bb4551-48fe-4635-a590-83248e7948be" (UID: "e9bb4551-48fe-4635-a590-83248e7948be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:11:49.384005 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.383968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9bb4551-48fe-4635-a590-83248e7948be" (UID: "e9bb4551-48fe-4635-a590-83248e7948be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:11:49.384071 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.383994    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9bb4551-48fe-4635-a590-83248e7948be-kube-api-access-kmnjl" (OuterVolumeSpecName: "kube-api-access-kmnjl") pod "e9bb4551-48fe-4635-a590-83248e7948be" (UID: "e9bb4551-48fe-4635-a590-83248e7948be"). InnerVolumeSpecName "kube-api-access-kmnjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:11:49.384226 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.384210    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0613b133-92d5-43b8-9128-cc7c23e1a6ca-kube-api-access-qtnzz" (OuterVolumeSpecName: "kube-api-access-qtnzz") pod "0613b133-92d5-43b8-9128-cc7c23e1a6ca" (UID: "0613b133-92d5-43b8-9128-cc7c23e1a6ca"). InnerVolumeSpecName "kube-api-access-qtnzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:11:49.484109 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.484068    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmnjl\" (UniqueName: \"kubernetes.io/projected/e9bb4551-48fe-4635-a590-83248e7948be-kube-api-access-kmnjl\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.484109 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.484099    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.484109 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.484114    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtnzz\" (UniqueName: \"kubernetes.io/projected/0613b133-92d5-43b8-9128-cc7c23e1a6ca-kube-api-access-qtnzz\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:49.484340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:49.484127    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9bb4551-48fe-4635-a590-83248e7948be-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:11:50.032826 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.032794    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9bb4551-48fe-4635-a590-83248e7948be" containerID="f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8" exitCode=0
Sep 09 16:11:50.033239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.032832    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"
Sep 09 16:11:50.033239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.032885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" event={"ID":"e9bb4551-48fe-4635-a590-83248e7948be","Type":"ContainerDied","Data":"f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8"}
Sep 09 16:11:50.033239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.032940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r" event={"ID":"e9bb4551-48fe-4635-a590-83248e7948be","Type":"ContainerDied","Data":"adbfc00815a3172494f72a7e1c9c53f4f6b2919896cabe9dbfad1fa133488feb"}
Sep 09 16:11:50.033239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.032964    2578 scope.go:117] "RemoveContainer" containerID="f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8"
Sep 09 16:11:50.034610 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.034588    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"
Sep 09 16:11:50.034743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.034619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s" event={"ID":"0613b133-92d5-43b8-9128-cc7c23e1a6ca","Type":"ContainerDied","Data":"93a460b8856245d90297041a8a99b1fef8f908537100ce9c35a3da843d46900c"}
Sep 09 16:11:50.036169 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.036153    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"
Sep 09 16:11:50.036169 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.036164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj" event={"ID":"f0d25e3e-1704-41ef-bebf-8e3668ca5030","Type":"ContainerDied","Data":"1ad6134ff499089ea36ebce45bfb26b5de5e3fedfd1a67da64e4bd49b62a031f"}
Sep 09 16:11:50.043736 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.043717    2578 scope.go:117] "RemoveContainer" containerID="f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8"
Sep 09 16:11:50.044017 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:11:50.043998    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8\": container with ID starting with f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8 not found: ID does not exist" containerID="f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8"
Sep 09 16:11:50.044085 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.044024    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8"} err="failed to get container status \"f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8\": rpc error: code = NotFound desc = could not find container \"f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8\": container with ID starting with f799d2d15778a1b7f1c7eb926a3efe1139052abfa9f39e0d771ebfaffd2c7da8 not found: ID does not exist"
Sep 09 16:11:50.044085 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.044039    2578 scope.go:117] "RemoveContainer" containerID="c9f0b44161c578009e85d0c6caf7cf3e05391ce77ce6d443df5c1cc6fbfc0ade"
Sep 09 16:11:50.052428 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.052414    2578 scope.go:117] "RemoveContainer" containerID="f71df7ae1a52d3a7a080ea890ada6e49d86950c233c8e7940d5587eaafd46acc"
Sep 09 16:11:50.064784 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.064754    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"]
Sep 09 16:11:50.068160 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.068142    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s"]
Sep 09 16:11:50.079070 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.079048    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"]
Sep 09 16:11:50.083916 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.083898    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f772da8e-76d89bbb7c-z5rhj"]
Sep 09 16:11:50.093725 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.093679    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"]
Sep 09 16:11:50.099291 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:50.099273    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a09c2a-7ff5768949-lhs2r"]
Sep 09 16:11:51.367881 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:51.367840    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0613b133-92d5-43b8-9128-cc7c23e1a6ca" path="/var/lib/kubelet/pods/0613b133-92d5-43b8-9128-cc7c23e1a6ca/volumes"
Sep 09 16:11:51.368430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:51.368410    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9bb4551-48fe-4635-a590-83248e7948be" path="/var/lib/kubelet/pods/e9bb4551-48fe-4635-a590-83248e7948be/volumes"
Sep 09 16:11:51.368832 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:11:51.368813    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0d25e3e-1704-41ef-bebf-8e3668ca5030" path="/var/lib/kubelet/pods/f0d25e3e-1704-41ef-bebf-8e3668ca5030/volumes"
Sep 09 16:12:37.334599 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.334567    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"]
Sep 09 16:12:37.334982 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.334954    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0613b133-92d5-43b8-9128-cc7c23e1a6ca" containerName="payload-pre-processing"
Sep 09 16:12:37.334982 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.334967    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0613b133-92d5-43b8-9128-cc7c23e1a6ca" containerName="payload-pre-processing"
Sep 09 16:12:37.334982 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.334982    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9bb4551-48fe-4635-a590-83248e7948be" containerName="maas-api"
Sep 09 16:12:37.335087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.334989    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9bb4551-48fe-4635-a590-83248e7948be" containerName="maas-api"
Sep 09 16:12:37.335087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.334996    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0d25e3e-1704-41ef-bebf-8e3668ca5030" containerName="maas-api"
Sep 09 16:12:37.335087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.335001    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0d25e3e-1704-41ef-bebf-8e3668ca5030" containerName="maas-api"
Sep 09 16:12:37.335087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.335059    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9bb4551-48fe-4635-a590-83248e7948be" containerName="maas-api"
Sep 09 16:12:37.335087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.335067    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0613b133-92d5-43b8-9128-cc7c23e1a6ca" containerName="payload-pre-processing"
Sep 09 16:12:37.335087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.335075    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0d25e3e-1704-41ef-bebf-8e3668ca5030" containerName="maas-api"
Sep 09 16:12:37.339421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.339399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.341919 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.341897    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-bfb318-serving-cert\""
Sep 09 16:12:37.351545 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.351437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"]
Sep 09 16:12:37.406337 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.406310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-metrics-certs\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.406483 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.406386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs2j8\" (UniqueName: \"kubernetes.io/projected/46963f71-3962-4372-be45-bcf39104695f-kube-api-access-xs2j8\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.406483 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.406432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.406483 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.406463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46963f71-3962-4372-be45-bcf39104695f-openshift-service-ca\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.507927 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.507897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-metrics-certs\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.508063 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.507944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs2j8\" (UniqueName: \"kubernetes.io/projected/46963f71-3962-4372-be45-bcf39104695f-kube-api-access-xs2j8\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.508063 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.507973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.508063 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.507993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46963f71-3962-4372-be45-bcf39104695f-openshift-service-ca\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.508178 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:12:37.508108    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-serving-cert: secret "maas-api-e2e-explicit-bfb318-serving-cert" not found
Sep 09 16:12:37.508216 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:12:37.508189    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls podName:46963f71-3962-4372-be45-bcf39104695f nodeName:}" failed. No retries permitted until 2026-09-09 16:12:38.008170081 +0000 UTC m=+1269.269299238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls") pod "maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" (UID: "46963f71-3962-4372-be45-bcf39104695f") : secret "maas-api-e2e-explicit-bfb318-serving-cert" not found
Sep 09 16:12:37.508610 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.508591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46963f71-3962-4372-be45-bcf39104695f-openshift-service-ca\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.510451 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.510429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-metrics-certs\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.515406 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.515386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs2j8\" (UniqueName: \"kubernetes.io/projected/46963f71-3962-4372-be45-bcf39104695f-kube-api-access-xs2j8\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:37.991660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.991626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"]
Sep 09 16:12:37.995483 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.995462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:37.995937 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.995911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"]
Sep 09 16:12:37.998506 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.998481    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-bfb318-dockercfg-89blk\""
Sep 09 16:12:37.998764 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:37.998748    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-bfb318\""
Sep 09 16:12:38.013728 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.013702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:38.015905 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.015881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls\") pod \"maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:38.114449 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.114415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0915ec-cf0c-421e-81af-b200927514fa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.114605 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.114546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54rxp\" (UniqueName: \"kubernetes.io/projected/fc0915ec-cf0c-421e-81af-b200927514fa-kube-api-access-54rxp\") pod \"payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.215905 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.215873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54rxp\" (UniqueName: \"kubernetes.io/projected/fc0915ec-cf0c-421e-81af-b200927514fa-kube-api-access-54rxp\") pod \"payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.216062 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.215919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0915ec-cf0c-421e-81af-b200927514fa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.216704 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.216685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0915ec-cf0c-421e-81af-b200927514fa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.223926 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.223909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54rxp\" (UniqueName: \"kubernetes.io/projected/fc0915ec-cf0c-421e-81af-b200927514fa-kube-api-access-54rxp\") pod \"payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.252848 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.252797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:38.307045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.307015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:38.528402 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.528372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"]
Sep 09 16:12:38.529403 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:12:38.529367    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46963f71_3962_4372_be45_bcf39104695f.slice/crio-c7ca3578c70e18351244230faee4b48d075bc0d5f027cc41536caf768eb197e0 WatchSource:0}: Error finding container c7ca3578c70e18351244230faee4b48d075bc0d5f027cc41536caf768eb197e0: Status 404 returned error can't find the container with id c7ca3578c70e18351244230faee4b48d075bc0d5f027cc41536caf768eb197e0
Sep 09 16:12:38.530840 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.530820    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:12:38.588747 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:38.588725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"]
Sep 09 16:12:38.590549 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:12:38.590525    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0915ec_cf0c_421e_81af_b200927514fa.slice/crio-21c7f083c5eaad56a373a590604f2b407e855d332d40332c9bf5e3e84895a1e1 WatchSource:0}: Error finding container 21c7f083c5eaad56a373a590604f2b407e855d332d40332c9bf5e3e84895a1e1: Status 404 returned error can't find the container with id 21c7f083c5eaad56a373a590604f2b407e855d332d40332c9bf5e3e84895a1e1
Sep 09 16:12:39.320737 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.320698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" event={"ID":"46963f71-3962-4372-be45-bcf39104695f","Type":"ContainerStarted","Data":"d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5"}
Sep 09 16:12:39.320932 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.320770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" event={"ID":"46963f71-3962-4372-be45-bcf39104695f","Type":"ContainerStarted","Data":"c7ca3578c70e18351244230faee4b48d075bc0d5f027cc41536caf768eb197e0"}
Sep 09 16:12:39.321007 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.320943    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:39.322548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.322521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc" event={"ID":"fc0915ec-cf0c-421e-81af-b200927514fa","Type":"ContainerStarted","Data":"5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3"}
Sep 09 16:12:39.322683 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.322567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc" event={"ID":"fc0915ec-cf0c-421e-81af-b200927514fa","Type":"ContainerStarted","Data":"21c7f083c5eaad56a373a590604f2b407e855d332d40332c9bf5e3e84895a1e1"}
Sep 09 16:12:39.322683 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.322593    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:12:39.357301 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.357253    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" podStartSLOduration=1.7743952699999999 podStartE2EDuration="2.357239667s" totalImagesPullingTime="582.844397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:39.354705924 +0000 UTC m=+1270.615835101" watchObservedRunningTime="2026-09-09 16:12:39.357239667 +0000 UTC m=+1270.618368834"
Sep 09 16:12:39.370511 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:39.370419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc" podStartSLOduration=2.370401956 podStartE2EDuration="2.370401956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:39.369851713 +0000 UTC m=+1270.630980894" watchObservedRunningTime="2026-09-09 16:12:39.370401956 +0000 UTC m=+1270.631531134"
Sep 09 16:12:45.333394 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:45.333365    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:12:50.330806 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:12:50.330776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:13:29.763891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.763860    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"]
Sep 09 16:13:29.767612 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.767591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.770651 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.770626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-677907eb-serving-cert\""
Sep 09 16:13:29.784493 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.779342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"]
Sep 09 16:13:29.884934 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.884889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-metrics-certs\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.885096 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.884967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.885156 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.885103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txp9\" (UniqueName: \"kubernetes.io/projected/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-kube-api-access-8txp9\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.885206 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.885155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-openshift-service-ca\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.986359 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.986315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.986523 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.986411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txp9\" (UniqueName: \"kubernetes.io/projected/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-kube-api-access-8txp9\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.986523 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.986453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-openshift-service-ca\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.986523 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:29.986481    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-serving-cert: secret "maas-api-e2e-mt-677907eb-serving-cert" not found
Sep 09 16:13:29.986756 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:29.986550    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls podName:39fcb9b8-3743-473e-95cd-d0a4ec0eb30f nodeName:}" failed. No retries permitted until 2026-09-09 16:13:30.48652863 +0000 UTC m=+1321.747657786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls") pod "maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" (UID: "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f") : secret "maas-api-e2e-mt-677907eb-serving-cert" not found
Sep 09 16:13:29.986756 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.986587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-metrics-certs\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.987146 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.987125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-openshift-service-ca\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.988961 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.988940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-metrics-certs\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:29.994950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:29.994929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txp9\" (UniqueName: \"kubernetes.io/projected/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-kube-api-access-8txp9\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:30.491136 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:30.491099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:30.493439 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:30.493416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls\") pod \"maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:30.680584 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:30.680549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:30.956528 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:30.956492    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"]
Sep 09 16:13:30.963205 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:13:30.963178    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fcb9b8_3743_473e_95cd_d0a4ec0eb30f.slice/crio-7370a0a1672b5b2b5b98247b9fe2dd4cca20eddd1e538a9c1546dc717c35b6cc WatchSource:0}: Error finding container 7370a0a1672b5b2b5b98247b9fe2dd4cca20eddd1e538a9c1546dc717c35b6cc: Status 404 returned error can't find the container with id 7370a0a1672b5b2b5b98247b9fe2dd4cca20eddd1e538a9c1546dc717c35b6cc
Sep 09 16:13:31.625903 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:31.625864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" event={"ID":"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f","Type":"ContainerStarted","Data":"7370a0a1672b5b2b5b98247b9fe2dd4cca20eddd1e538a9c1546dc717c35b6cc"}
Sep 09 16:13:34.643803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:34.643770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" event={"ID":"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f","Type":"ContainerStarted","Data":"bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5"}
Sep 09 16:13:34.644174 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:34.643900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:34.661119 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:34.661077    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" podStartSLOduration=2.883289315 podStartE2EDuration="5.661063389s" totalImagesPullingTime="2.777774074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:34.659271449 +0000 UTC m=+1325.920400627" watchObservedRunningTime="2026-09-09 16:13:34.661063389 +0000 UTC m=+1325.922192565"
Sep 09 16:13:36.864914 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:36.864869    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"]
Sep 09 16:13:36.865502 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:36.865116    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" podUID="46963f71-3962-4372-be45-bcf39104695f" containerName="maas-api" containerID="cri-o://d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5" gracePeriod=30
Sep 09 16:13:36.930112 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:36.930059    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"]
Sep 09 16:13:36.930732 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:36.930678    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc" podUID="fc0915ec-cf0c-421e-81af-b200927514fa" containerName="payload-processing" containerID="cri-o://5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3" gracePeriod=30
Sep 09 16:13:37.201020 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.200931    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:13:37.232248 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.232222    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:13:37.350470 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350439    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54rxp\" (UniqueName: \"kubernetes.io/projected/fc0915ec-cf0c-421e-81af-b200927514fa-kube-api-access-54rxp\") pod \"fc0915ec-cf0c-421e-81af-b200927514fa\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") "
Sep 09 16:13:37.350646 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0915ec-cf0c-421e-81af-b200927514fa-plugins-config-volume\") pod \"fc0915ec-cf0c-421e-81af-b200927514fa\" (UID: \"fc0915ec-cf0c-421e-81af-b200927514fa\") "
Sep 09 16:13:37.350646 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls\") pod \"46963f71-3962-4372-be45-bcf39104695f\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") "
Sep 09 16:13:37.350646 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350636    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-metrics-certs\") pod \"46963f71-3962-4372-be45-bcf39104695f\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") "
Sep 09 16:13:37.350814 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs2j8\" (UniqueName: \"kubernetes.io/projected/46963f71-3962-4372-be45-bcf39104695f-kube-api-access-xs2j8\") pod \"46963f71-3962-4372-be45-bcf39104695f\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") "
Sep 09 16:13:37.350814 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350701    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46963f71-3962-4372-be45-bcf39104695f-openshift-service-ca\") pod \"46963f71-3962-4372-be45-bcf39104695f\" (UID: \"46963f71-3962-4372-be45-bcf39104695f\") "
Sep 09 16:13:37.351054 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.350935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0915ec-cf0c-421e-81af-b200927514fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc0915ec-cf0c-421e-81af-b200927514fa" (UID: "fc0915ec-cf0c-421e-81af-b200927514fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:13:37.351142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.351099    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46963f71-3962-4372-be45-bcf39104695f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46963f71-3962-4372-be45-bcf39104695f" (UID: "46963f71-3962-4372-be45-bcf39104695f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:13:37.352743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.352715    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "46963f71-3962-4372-be45-bcf39104695f" (UID: "46963f71-3962-4372-be45-bcf39104695f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:13:37.352857 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.352779    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46963f71-3962-4372-be45-bcf39104695f" (UID: "46963f71-3962-4372-be45-bcf39104695f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:13:37.352993 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.352974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0915ec-cf0c-421e-81af-b200927514fa-kube-api-access-54rxp" (OuterVolumeSpecName: "kube-api-access-54rxp") pod "fc0915ec-cf0c-421e-81af-b200927514fa" (UID: "fc0915ec-cf0c-421e-81af-b200927514fa"). InnerVolumeSpecName "kube-api-access-54rxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:13:37.353070 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.353052    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46963f71-3962-4372-be45-bcf39104695f-kube-api-access-xs2j8" (OuterVolumeSpecName: "kube-api-access-xs2j8") pod "46963f71-3962-4372-be45-bcf39104695f" (UID: "46963f71-3962-4372-be45-bcf39104695f"). InnerVolumeSpecName "kube-api-access-xs2j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:13:37.452384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.452359    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:37.452384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.452381    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46963f71-3962-4372-be45-bcf39104695f-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:37.452525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.452391    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs2j8\" (UniqueName: \"kubernetes.io/projected/46963f71-3962-4372-be45-bcf39104695f-kube-api-access-xs2j8\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:37.452525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.452400    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46963f71-3962-4372-be45-bcf39104695f-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:37.452525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.452409    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54rxp\" (UniqueName: \"kubernetes.io/projected/fc0915ec-cf0c-421e-81af-b200927514fa-kube-api-access-54rxp\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:37.452525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.452419    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc0915ec-cf0c-421e-81af-b200927514fa-plugins-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:37.662258 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.662227    2578 generic.go:356] "Generic (PLEG): container finished" podID="46963f71-3962-4372-be45-bcf39104695f" containerID="d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5" exitCode=0
Sep 09 16:13:37.662407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.662265    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"
Sep 09 16:13:37.662407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.662307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" event={"ID":"46963f71-3962-4372-be45-bcf39104695f","Type":"ContainerDied","Data":"d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5"}
Sep 09 16:13:37.662407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.662373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc" event={"ID":"46963f71-3962-4372-be45-bcf39104695f","Type":"ContainerDied","Data":"c7ca3578c70e18351244230faee4b48d075bc0d5f027cc41536caf768eb197e0"}
Sep 09 16:13:37.662407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.662405    2578 scope.go:117] "RemoveContainer" containerID="d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5"
Sep 09 16:13:37.663789 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.663764    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc0915ec-cf0c-421e-81af-b200927514fa" containerID="5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3" exitCode=0
Sep 09 16:13:37.663891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.663800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc" event={"ID":"fc0915ec-cf0c-421e-81af-b200927514fa","Type":"ContainerDied","Data":"5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3"}
Sep 09 16:13:37.663891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.663828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"
Sep 09 16:13:37.663891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.663849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc" event={"ID":"fc0915ec-cf0c-421e-81af-b200927514fa","Type":"ContainerDied","Data":"21c7f083c5eaad56a373a590604f2b407e855d332d40332c9bf5e3e84895a1e1"}
Sep 09 16:13:37.671728 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.671709    2578 scope.go:117] "RemoveContainer" containerID="d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5"
Sep 09 16:13:37.672003 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:37.671986    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5\": container with ID starting with d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5 not found: ID does not exist" containerID="d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5"
Sep 09 16:13:37.672071 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.672010    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5"} err="failed to get container status \"d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5\": rpc error: code = NotFound desc = could not find container \"d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5\": container with ID starting with d71db8af3d6276a51d4958b5ea956b80bec69504fc46c71ee66a28506c19d1b5 not found: ID does not exist"
Sep 09 16:13:37.672071 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.672026    2578 scope.go:117] "RemoveContainer" containerID="5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3"
Sep 09 16:13:37.681298 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.681271    2578 scope.go:117] "RemoveContainer" containerID="5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3"
Sep 09 16:13:37.681651 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:37.681620    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3\": container with ID starting with 5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3 not found: ID does not exist" containerID="5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3"
Sep 09 16:13:37.681768 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.681649    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3"} err="failed to get container status \"5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3\": rpc error: code = NotFound desc = could not find container \"5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3\": container with ID starting with 5e1db9b4b6cb7c7f46746d40015bc30693c010f1f2ec65228f641a6d4c5c3ae3 not found: ID does not exist"
Sep 09 16:13:37.684785 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.684765    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"]
Sep 09 16:13:37.690542 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.690522    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-bfb318-6dcdbb7754-47jdc"]
Sep 09 16:13:37.703747 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.703698    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"]
Sep 09 16:13:37.711340 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:37.711320    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc"]
Sep 09 16:13:38.007963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.007883    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"]
Sep 09 16:13:38.008395 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.008077    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" podUID="e64d1a99-d23c-4b8f-8360-d9ae581533b9" containerName="maas-api" containerID="cri-o://cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce" gracePeriod=30
Sep 09 16:13:38.058437 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.058405    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"]
Sep 09 16:13:38.058631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.058604    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x" podUID="78721d49-abfa-44e5-92ba-af16aeca7415" containerName="payload-processing" containerID="cri-o://197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4" gracePeriod=30
Sep 09 16:13:38.310224 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.310203    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:13:38.336358 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.336321    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:13:38.462056 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-metrics-certs\") pod \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") "
Sep 09 16:13:38.462208 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462060    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78721d49-abfa-44e5-92ba-af16aeca7415-plugins-config-volume\") pod \"78721d49-abfa-44e5-92ba-af16aeca7415\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") "
Sep 09 16:13:38.462208 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64d1a99-d23c-4b8f-8360-d9ae581533b9-openshift-service-ca\") pod \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") "
Sep 09 16:13:38.462208 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzc95\" (UniqueName: \"kubernetes.io/projected/e64d1a99-d23c-4b8f-8360-d9ae581533b9-kube-api-access-nzc95\") pod \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") "
Sep 09 16:13:38.462208 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q67qj\" (UniqueName: \"kubernetes.io/projected/78721d49-abfa-44e5-92ba-af16aeca7415-kube-api-access-q67qj\") pod \"78721d49-abfa-44e5-92ba-af16aeca7415\" (UID: \"78721d49-abfa-44e5-92ba-af16aeca7415\") "
Sep 09 16:13:38.462418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls\") pod \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\" (UID: \"e64d1a99-d23c-4b8f-8360-d9ae581533b9\") "
Sep 09 16:13:38.462584 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462551    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64d1a99-d23c-4b8f-8360-d9ae581533b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e64d1a99-d23c-4b8f-8360-d9ae581533b9" (UID: "e64d1a99-d23c-4b8f-8360-d9ae581533b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:13:38.462714 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.462587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78721d49-abfa-44e5-92ba-af16aeca7415-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "78721d49-abfa-44e5-92ba-af16aeca7415" (UID: "78721d49-abfa-44e5-92ba-af16aeca7415"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:13:38.464256 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.464229    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e64d1a99-d23c-4b8f-8360-d9ae581533b9" (UID: "e64d1a99-d23c-4b8f-8360-d9ae581533b9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:13:38.464360 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.464283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e64d1a99-d23c-4b8f-8360-d9ae581533b9" (UID: "e64d1a99-d23c-4b8f-8360-d9ae581533b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:13:38.464360 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.464337    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64d1a99-d23c-4b8f-8360-d9ae581533b9-kube-api-access-nzc95" (OuterVolumeSpecName: "kube-api-access-nzc95") pod "e64d1a99-d23c-4b8f-8360-d9ae581533b9" (UID: "e64d1a99-d23c-4b8f-8360-d9ae581533b9"). InnerVolumeSpecName "kube-api-access-nzc95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:13:38.464472 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.464379    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78721d49-abfa-44e5-92ba-af16aeca7415-kube-api-access-q67qj" (OuterVolumeSpecName: "kube-api-access-q67qj") pod "78721d49-abfa-44e5-92ba-af16aeca7415" (UID: "78721d49-abfa-44e5-92ba-af16aeca7415"). InnerVolumeSpecName "kube-api-access-q67qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:13:38.563811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.563737    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64d1a99-d23c-4b8f-8360-d9ae581533b9-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:38.563811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.563763    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzc95\" (UniqueName: \"kubernetes.io/projected/e64d1a99-d23c-4b8f-8360-d9ae581533b9-kube-api-access-nzc95\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:38.563811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.563772    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q67qj\" (UniqueName: \"kubernetes.io/projected/78721d49-abfa-44e5-92ba-af16aeca7415-kube-api-access-q67qj\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:38.563811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.563795    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:38.563811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.563805    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64d1a99-d23c-4b8f-8360-d9ae581533b9-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:38.563811 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.563813    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78721d49-abfa-44e5-92ba-af16aeca7415-plugins-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:38.672022 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.671992    2578 generic.go:356] "Generic (PLEG): container finished" podID="78721d49-abfa-44e5-92ba-af16aeca7415" containerID="197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4" exitCode=0
Sep 09 16:13:38.672142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.672037    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"
Sep 09 16:13:38.672142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.672079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x" event={"ID":"78721d49-abfa-44e5-92ba-af16aeca7415","Type":"ContainerDied","Data":"197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4"}
Sep 09 16:13:38.672142 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.672137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x" event={"ID":"78721d49-abfa-44e5-92ba-af16aeca7415","Type":"ContainerDied","Data":"ec4ca9dee0c62c061b3aaa133cc75baaeb75a6f7e181d4c5c5bb6357d22c1831"}
Sep 09 16:13:38.672273 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.672168    2578 scope.go:117] "RemoveContainer" containerID="197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4"
Sep 09 16:13:38.674769 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.674749    2578 generic.go:356] "Generic (PLEG): container finished" podID="e64d1a99-d23c-4b8f-8360-d9ae581533b9" containerID="cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce" exitCode=0
Sep 09 16:13:38.674867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.674779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" event={"ID":"e64d1a99-d23c-4b8f-8360-d9ae581533b9","Type":"ContainerDied","Data":"cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce"}
Sep 09 16:13:38.674867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.674807    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"
Sep 09 16:13:38.674867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.674835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf" event={"ID":"e64d1a99-d23c-4b8f-8360-d9ae581533b9","Type":"ContainerDied","Data":"00815b02429490f4ef5c72d4122575d5b7d49470804acc9ebdea5ad26cec01b2"}
Sep 09 16:13:38.682679 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.682650    2578 scope.go:117] "RemoveContainer" containerID="197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4"
Sep 09 16:13:38.682958 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:38.682921    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4\": container with ID starting with 197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4 not found: ID does not exist" containerID="197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4"
Sep 09 16:13:38.683111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.682957    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4"} err="failed to get container status \"197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4\": rpc error: code = NotFound desc = could not find container \"197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4\": container with ID starting with 197fe77a14b93549d76b65799860479b2cd30d328bf524c6bbedaf70b853efe4 not found: ID does not exist"
Sep 09 16:13:38.683111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.682974    2578 scope.go:117] "RemoveContainer" containerID="cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce"
Sep 09 16:13:38.692197 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.692181    2578 scope.go:117] "RemoveContainer" containerID="cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce"
Sep 09 16:13:38.692497 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:38.692479    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce\": container with ID starting with cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce not found: ID does not exist" containerID="cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce"
Sep 09 16:13:38.692559 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.692503    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce"} err="failed to get container status \"cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce\": rpc error: code = NotFound desc = could not find container \"cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce\": container with ID starting with cbad597ce0bce2b78b3dcf1e9d08f165d0aaee666969eae25179e609c53aa5ce not found: ID does not exist"
Sep 09 16:13:38.697138 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.697118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"]
Sep 09 16:13:38.701493 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.701474    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x"]
Sep 09 16:13:38.712240 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.712221    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"]
Sep 09 16:13:38.718002 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:38.717981    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b8369-5c99bdb7fb-f4xbf"]
Sep 09 16:13:39.369995 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:39.369963    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46963f71-3962-4372-be45-bcf39104695f" path="/var/lib/kubelet/pods/46963f71-3962-4372-be45-bcf39104695f/volumes"
Sep 09 16:13:39.370343 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:39.370315    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78721d49-abfa-44e5-92ba-af16aeca7415" path="/var/lib/kubelet/pods/78721d49-abfa-44e5-92ba-af16aeca7415/volumes"
Sep 09 16:13:39.370684 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:39.370670    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e64d1a99-d23c-4b8f-8360-d9ae581533b9" path="/var/lib/kubelet/pods/e64d1a99-d23c-4b8f-8360-d9ae581533b9/volumes"
Sep 09 16:13:39.371285 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:39.371255    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc0915ec-cf0c-421e-81af-b200927514fa" path="/var/lib/kubelet/pods/fc0915ec-cf0c-421e-81af-b200927514fa/volumes"
Sep 09 16:13:40.654528 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:40.654496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:13:44.557390 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.557343    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"]
Sep 09 16:13:44.557975 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.557952    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64d1a99-d23c-4b8f-8360-d9ae581533b9" containerName="maas-api"
Sep 09 16:13:44.558039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.557977    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64d1a99-d23c-4b8f-8360-d9ae581533b9" containerName="maas-api"
Sep 09 16:13:44.558039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.557994    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0915ec-cf0c-421e-81af-b200927514fa" containerName="payload-processing"
Sep 09 16:13:44.558039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558000    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0915ec-cf0c-421e-81af-b200927514fa" containerName="payload-processing"
Sep 09 16:13:44.558039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558022    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46963f71-3962-4372-be45-bcf39104695f" containerName="maas-api"
Sep 09 16:13:44.558039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558031    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46963f71-3962-4372-be45-bcf39104695f" containerName="maas-api"
Sep 09 16:13:44.558039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558041    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78721d49-abfa-44e5-92ba-af16aeca7415" containerName="payload-processing"
Sep 09 16:13:44.558316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558050    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="78721d49-abfa-44e5-92ba-af16aeca7415" containerName="payload-processing"
Sep 09 16:13:44.558316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558136    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46963f71-3962-4372-be45-bcf39104695f" containerName="maas-api"
Sep 09 16:13:44.558316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558147    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0915ec-cf0c-421e-81af-b200927514fa" containerName="payload-processing"
Sep 09 16:13:44.558316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558158    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64d1a99-d23c-4b8f-8360-d9ae581533b9" containerName="maas-api"
Sep 09 16:13:44.558316 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.558169    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="78721d49-abfa-44e5-92ba-af16aeca7415" containerName="payload-processing"
Sep 09 16:13:44.563174 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.563149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.565762 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.565742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-a372ad-openshift-default-dockercfg-pxvmg\""
Sep 09 16:13:44.571328 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.571303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"]
Sep 09 16:13:44.715683 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-credential-socket\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715683 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91452efa-61f3-408d-96d6-a0541c689291-istiod-ca-cert\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldv8h\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-kube-api-access-ldv8h\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-envoy\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-data\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-certs\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91452efa-61f3-408d-96d6-a0541c689291-istio-podinfo\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.715901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-istio-token\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.716160 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.715920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-socket\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817437 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-data\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817437 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-certs\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91452efa-61f3-408d-96d6-a0541c689291-istio-podinfo\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-istio-token\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-socket\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-credential-socket\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91452efa-61f3-408d-96d6-a0541c689291-istiod-ca-cert\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldv8h\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-kube-api-access-ldv8h\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-envoy\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.817861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-certs\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.818016 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-data\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.818016 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.817984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-socket\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.818016 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.818006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-credential-socket\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.818386 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.818336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91452efa-61f3-408d-96d6-a0541c689291-istiod-ca-cert\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.819782 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.819762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-envoy\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.819925 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.819905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91452efa-61f3-408d-96d6-a0541c689291-istio-podinfo\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.824901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.824871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-istio-token\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.825072 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.825052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldv8h\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-kube-api-access-ldv8h\") pod \"e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") " pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:44.875931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:44.875904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:45.155144 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:45.155059    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"]
Sep 09 16:13:45.157465 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:13:45.157430    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91452efa_61f3_408d_96d6_a0541c689291.slice/crio-3775231bb6b319485f9199bbf306256699d2d868470b57ec0727e4c321a63636 WatchSource:0}: Error finding container 3775231bb6b319485f9199bbf306256699d2d868470b57ec0727e4c321a63636: Status 404 returned error can't find the container with id 3775231bb6b319485f9199bbf306256699d2d868470b57ec0727e4c321a63636
Sep 09 16:13:45.717931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:45.717887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" event={"ID":"91452efa-61f3-408d-96d6-a0541c689291","Type":"ContainerStarted","Data":"3775231bb6b319485f9199bbf306256699d2d868470b57ec0727e4c321a63636"}
Sep 09 16:13:47.693898 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:47.693862    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:13:47.694138 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:47.693937    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:13:47.694138 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:47.693966    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:13:48.738065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:48.738029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" event={"ID":"91452efa-61f3-408d-96d6-a0541c689291","Type":"ContainerStarted","Data":"7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa"}
Sep 09 16:13:48.758190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:48.758141    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" podStartSLOduration=2.224042711 podStartE2EDuration="4.758126724s" totalImagesPullingTime="2.534084013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:48.756248922 +0000 UTC m=+1340.017378100" watchObservedRunningTime="2026-09-09 16:13:48.758126724 +0000 UTC m=+1340.019255902"
Sep 09 16:13:48.876972 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:48.876944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:48.881956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:48.881932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:49.743707 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:49.743682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:49.744675 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:49.744655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:13:56.472204 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:56.472158    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"]
Sep 09 16:13:56.472976 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:56.472924    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" podUID="f8ec3b62-5f0f-4921-940f-b3951190f307" containerName="maas-api" containerID="cri-o://bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88" gracePeriod=30
Sep 09 16:13:56.935414 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:56.935388    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:13:57.026114 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.026043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-metrics-certs\") pod \"f8ec3b62-5f0f-4921-940f-b3951190f307\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") "
Sep 09 16:13:57.026257 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.026136    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls\") pod \"f8ec3b62-5f0f-4921-940f-b3951190f307\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") "
Sep 09 16:13:57.026257 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.026154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ec3b62-5f0f-4921-940f-b3951190f307-openshift-service-ca\") pod \"f8ec3b62-5f0f-4921-940f-b3951190f307\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") "
Sep 09 16:13:57.026257 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.026170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5d2h\" (UniqueName: \"kubernetes.io/projected/f8ec3b62-5f0f-4921-940f-b3951190f307-kube-api-access-r5d2h\") pod \"f8ec3b62-5f0f-4921-940f-b3951190f307\" (UID: \"f8ec3b62-5f0f-4921-940f-b3951190f307\") "
Sep 09 16:13:57.026575 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.026549    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ec3b62-5f0f-4921-940f-b3951190f307-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8ec3b62-5f0f-4921-940f-b3951190f307" (UID: "f8ec3b62-5f0f-4921-940f-b3951190f307"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:13:57.028106 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.028082    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8ec3b62-5f0f-4921-940f-b3951190f307" (UID: "f8ec3b62-5f0f-4921-940f-b3951190f307"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:13:57.028186 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.028127    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8ec3b62-5f0f-4921-940f-b3951190f307" (UID: "f8ec3b62-5f0f-4921-940f-b3951190f307"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:13:57.028186 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.028143    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ec3b62-5f0f-4921-940f-b3951190f307-kube-api-access-r5d2h" (OuterVolumeSpecName: "kube-api-access-r5d2h") pod "f8ec3b62-5f0f-4921-940f-b3951190f307" (UID: "f8ec3b62-5f0f-4921-940f-b3951190f307"). InnerVolumeSpecName "kube-api-access-r5d2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:13:57.127204 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.127175    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:57.127204 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.127205    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ec3b62-5f0f-4921-940f-b3951190f307-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:57.127363 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.127219    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ec3b62-5f0f-4921-940f-b3951190f307-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:57.127363 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.127234    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5d2h\" (UniqueName: \"kubernetes.io/projected/f8ec3b62-5f0f-4921-940f-b3951190f307-kube-api-access-r5d2h\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:13:57.794135 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.794101    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8ec3b62-5f0f-4921-940f-b3951190f307" containerID="bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88" exitCode=0
Sep 09 16:13:57.794598 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.794164    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"
Sep 09 16:13:57.794598 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.794182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" event={"ID":"f8ec3b62-5f0f-4921-940f-b3951190f307","Type":"ContainerDied","Data":"bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88"}
Sep 09 16:13:57.794598 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.794242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp" event={"ID":"f8ec3b62-5f0f-4921-940f-b3951190f307","Type":"ContainerDied","Data":"d31a00c3be3c0dc6e3f2228ef33305be3a3c33c8d9d52bd656a375e09c1adb37"}
Sep 09 16:13:57.794598 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.794266    2578 scope.go:117] "RemoveContainer" containerID="bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88"
Sep 09 16:13:57.803887 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.803857    2578 scope.go:117] "RemoveContainer" containerID="bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88"
Sep 09 16:13:57.804133 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:13:57.804115    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88\": container with ID starting with bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88 not found: ID does not exist" containerID="bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88"
Sep 09 16:13:57.804184 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.804146    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88"} err="failed to get container status \"bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88\": rpc error: code = NotFound desc = could not find container \"bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88\": container with ID starting with bddfb4184a1f045b0aa2446fe232bcbd7888ef40c3deddfdfcdae1234066db88 not found: ID does not exist"
Sep 09 16:13:57.811436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.811410    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"]
Sep 09 16:13:57.815955 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:57.815934    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23ff1-58dc8d8b65-sl4dp"]
Sep 09 16:13:59.368563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:13:59.368523    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ec3b62-5f0f-4921-940f-b3951190f307" path="/var/lib/kubelet/pods/f8ec3b62-5f0f-4921-940f-b3951190f307/volumes"
Sep 09 16:14:08.032590 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.032555    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"]
Sep 09 16:14:08.033177 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.033158    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ec3b62-5f0f-4921-940f-b3951190f307" containerName="maas-api"
Sep 09 16:14:08.033225 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.033181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ec3b62-5f0f-4921-940f-b3951190f307" containerName="maas-api"
Sep 09 16:14:08.033297 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.033286    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ec3b62-5f0f-4921-940f-b3951190f307" containerName="maas-api"
Sep 09 16:14:08.038042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.038022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.040489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.040466    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-131689-serving-cert\""
Sep 09 16:14:08.047949 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.047469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"]
Sep 09 16:14:08.116367 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.116322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.116539 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.116385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.116539 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.116425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5pz\" (UniqueName: \"kubernetes.io/projected/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-kube-api-access-xj5pz\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.116539 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.116506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.217838 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.217810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.217978 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.217856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.217978 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.217909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5pz\" (UniqueName: \"kubernetes.io/projected/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-kube-api-access-xj5pz\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.217978 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.217973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.218610 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.218583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.220239 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.220218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.220372 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.220293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.225263 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.225241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5pz\" (UniqueName: \"kubernetes.io/projected/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-kube-api-access-xj5pz\") pod \"maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.352125 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.352058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:08.645454 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.645378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"]
Sep 09 16:14:08.648745 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:14:08.648713    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce61c741_9c11_4bf7_860a_a5c5a7d7bd1f.slice/crio-ccbd3bdc58cba03ad143f001d7a4b55554470a12e59b794ee7f6c91236b48ef8 WatchSource:0}: Error finding container ccbd3bdc58cba03ad143f001d7a4b55554470a12e59b794ee7f6c91236b48ef8: Status 404 returned error can't find the container with id ccbd3bdc58cba03ad143f001d7a4b55554470a12e59b794ee7f6c91236b48ef8
Sep 09 16:14:08.860774 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:08.860740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn" event={"ID":"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f","Type":"ContainerStarted","Data":"ccbd3bdc58cba03ad143f001d7a4b55554470a12e59b794ee7f6c91236b48ef8"}
Sep 09 16:14:09.875244 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:09.875208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn" event={"ID":"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f","Type":"ContainerStarted","Data":"e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51"}
Sep 09 16:14:09.875651 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:09.875393    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:09.893775 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:09.893731    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn" podStartSLOduration=1.48618951 podStartE2EDuration="1.893716061s" totalImagesPullingTime="407.526551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:09.892143472 +0000 UTC m=+1361.153272648" watchObservedRunningTime="2026-09-09 16:14:09.893716061 +0000 UTC m=+1361.154845236"
Sep 09 16:14:11.805114 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:11.805083    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"]
Sep 09 16:14:11.805589 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:11.805340    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" podUID="39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" containerName="maas-api" containerID="cri-o://bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5" gracePeriod=30
Sep 09 16:14:12.055899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.055840    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:14:12.155513 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.155484    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8txp9\" (UniqueName: \"kubernetes.io/projected/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-kube-api-access-8txp9\") pod \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") "
Sep 09 16:14:12.155680 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.155589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls\") pod \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") "
Sep 09 16:14:12.155680 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.155609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-metrics-certs\") pod \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") "
Sep 09 16:14:12.155680 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.155624    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-openshift-service-ca\") pod \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\" (UID: \"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f\") "
Sep 09 16:14:12.156060 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.156035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" (UID: "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:12.157763 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.157733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-kube-api-access-8txp9" (OuterVolumeSpecName: "kube-api-access-8txp9") pod "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" (UID: "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f"). InnerVolumeSpecName "kube-api-access-8txp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:12.157876 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.157776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" (UID: "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:12.157876 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.157801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" (UID: "39fcb9b8-3743-473e-95cd-d0a4ec0eb30f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:12.256706 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.256679    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:12.256706 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.256702    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:12.256863 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.256712    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:12.256863 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.256724    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8txp9\" (UniqueName: \"kubernetes.io/projected/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f-kube-api-access-8txp9\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:12.894114 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.894077    2578 generic.go:356] "Generic (PLEG): container finished" podID="39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" containerID="bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5" exitCode=0
Sep 09 16:14:12.894531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.894128    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"
Sep 09 16:14:12.894531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.894168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" event={"ID":"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f","Type":"ContainerDied","Data":"bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5"}
Sep 09 16:14:12.894531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.894222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n" event={"ID":"39fcb9b8-3743-473e-95cd-d0a4ec0eb30f","Type":"ContainerDied","Data":"7370a0a1672b5b2b5b98247b9fe2dd4cca20eddd1e538a9c1546dc717c35b6cc"}
Sep 09 16:14:12.894531 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.894245    2578 scope.go:117] "RemoveContainer" containerID="bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5"
Sep 09 16:14:12.904166 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.904151    2578 scope.go:117] "RemoveContainer" containerID="bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5"
Sep 09 16:14:12.904427 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:14:12.904411    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5\": container with ID starting with bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5 not found: ID does not exist" containerID="bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5"
Sep 09 16:14:12.904481 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.904435    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5"} err="failed to get container status \"bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5\": rpc error: code = NotFound desc = could not find container \"bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5\": container with ID starting with bd9688c8c934f90c49137a2d04f2f88780e1662b364f4bc80c6ff7e3b3ad3ee5 not found: ID does not exist"
Sep 09 16:14:12.915217 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.915194    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"]
Sep 09 16:14:12.918920 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:12.918900    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-677907eb-58bff56d8b-nfg5n"]
Sep 09 16:14:13.368095 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:13.368066    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" path="/var/lib/kubelet/pods/39fcb9b8-3743-473e-95cd-d0a4ec0eb30f/volumes"
Sep 09 16:14:15.886617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:15.886588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:14:18.065439 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:18.065405    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"]
Sep 09 16:14:18.065896 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:18.065632    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" podUID="91452efa-61f3-408d-96d6-a0541c689291" containerName="istio-proxy" containerID="cri-o://7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa" gracePeriod=30
Sep 09 16:14:19.746306 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:19.746269    2578 patch_prober.go:28] interesting pod/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:14:19.746781 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:19.746328    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" podUID="91452efa-61f3-408d-96d6-a0541c689291" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:14:23.312722 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.312697    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:14:23.461839 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461812    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91452efa-61f3-408d-96d6-a0541c689291-istiod-ca-cert\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldv8h\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-kube-api-access-ldv8h\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461881    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-data\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-certs\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-credential-socket\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461954    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91452efa-61f3-408d-96d6-a0541c689291-istio-podinfo\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.461973    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-istio-token\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462375 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-socket\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462375 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-envoy\") pod \"91452efa-61f3-408d-96d6-a0541c689291\" (UID: \"91452efa-61f3-408d-96d6-a0541c689291\") "
Sep 09 16:14:23.462375 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462207    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-data" (OuterVolumeSpecName: "istio-data") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:23.462375 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462302    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:23.462375 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462334    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91452efa-61f3-408d-96d6-a0541c689291-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:23.462642 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:23.462642 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462529    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:23.462772 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462749    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91452efa-61f3-408d-96d6-a0541c689291-istiod-ca-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.462833 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462777    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.462833 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462791    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.462833 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462805    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-credential-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.462833 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.462818    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-workload-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.464776 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.464745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91452efa-61f3-408d-96d6-a0541c689291-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:14:23.464873 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.464851    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:23.464873 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.464852    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-kube-api-access-ldv8h" (OuterVolumeSpecName: "kube-api-access-ldv8h") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "kube-api-access-ldv8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:23.464958 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.464877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-istio-token" (OuterVolumeSpecName: "istio-token") pod "91452efa-61f3-408d-96d6-a0541c689291" (UID: "91452efa-61f3-408d-96d6-a0541c689291"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:23.563745 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.563715    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-istio-token\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.563745 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.563742    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91452efa-61f3-408d-96d6-a0541c689291-istio-envoy\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.563878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.563752    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldv8h\" (UniqueName: \"kubernetes.io/projected/91452efa-61f3-408d-96d6-a0541c689291-kube-api-access-ldv8h\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.563878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.563761    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91452efa-61f3-408d-96d6-a0541c689291-istio-podinfo\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:14:23.957831 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.957800    2578 generic.go:356] "Generic (PLEG): container finished" podID="91452efa-61f3-408d-96d6-a0541c689291" containerID="7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa" exitCode=0
Sep 09 16:14:23.957994 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.957843    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"
Sep 09 16:14:23.957994 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.957851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" event={"ID":"91452efa-61f3-408d-96d6-a0541c689291","Type":"ContainerDied","Data":"7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa"}
Sep 09 16:14:23.957994 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.957900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj" event={"ID":"91452efa-61f3-408d-96d6-a0541c689291","Type":"ContainerDied","Data":"3775231bb6b319485f9199bbf306256699d2d868470b57ec0727e4c321a63636"}
Sep 09 16:14:23.957994 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.957925    2578 scope.go:117] "RemoveContainer" containerID="7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa"
Sep 09 16:14:23.967911 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.967895    2578 scope.go:117] "RemoveContainer" containerID="7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa"
Sep 09 16:14:23.968190 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:14:23.968170    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa\": container with ID starting with 7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa not found: ID does not exist" containerID="7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa"
Sep 09 16:14:23.968238 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.968198    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa"} err="failed to get container status \"7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa\": rpc error: code = NotFound desc = could not find container \"7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa\": container with ID starting with 7a6f2da5d4ffaf12cd10c79574d97ef3f5f17a57831f5193c0a20fed5e4e60aa not found: ID does not exist"
Sep 09 16:14:23.981068 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.981046    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"]
Sep 09 16:14:23.983450 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:23.983427    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj"]
Sep 09 16:14:25.368456 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:25.368423    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91452efa-61f3-408d-96d6-a0541c689291" path="/var/lib/kubelet/pods/91452efa-61f3-408d-96d6-a0541c689291/volumes"
Sep 09 16:14:32.558661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.558618    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"]
Sep 09 16:14:32.559021 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.559013    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91452efa-61f3-408d-96d6-a0541c689291" containerName="istio-proxy"
Sep 09 16:14:32.559060 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.559026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="91452efa-61f3-408d-96d6-a0541c689291" containerName="istio-proxy"
Sep 09 16:14:32.559060 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.559039    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" containerName="maas-api"
Sep 09 16:14:32.559060 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.559045    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" containerName="maas-api"
Sep 09 16:14:32.559159 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.559116    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="39fcb9b8-3743-473e-95cd-d0a4ec0eb30f" containerName="maas-api"
Sep 09 16:14:32.559159 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.559123    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="91452efa-61f3-408d-96d6-a0541c689291" containerName="istio-proxy"
Sep 09 16:14:32.563882 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.563864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.566382 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.566345    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-b0ce96-openshift-default-dockercfg-k5z45\""
Sep 09 16:14:32.573670 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.573645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"]
Sep 09 16:14:32.741548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw849\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-kube-api-access-gw849\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741548 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-credential-socket\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741749 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-socket\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741749 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-podinfo\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741749 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-envoy\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741749 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-certs\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741749 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-token\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741913 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-data\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.741913 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.741790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istiod-ca-cert\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.842822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw849\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-kube-api-access-gw849\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.842822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-credential-socket\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.842822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-socket\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-podinfo\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-envoy\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-certs\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-token\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.842994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-data\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.843021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istiod-ca-cert\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843459 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.843241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-credential-socket\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843459 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.843340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-certs\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843459 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.843427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-data\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843616 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.843538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-socket\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.843813 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.843791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istiod-ca-cert\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.845104 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.845087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-envoy\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.845362 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.845333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-podinfo\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.851435 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.851409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw849\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-kube-api-access-gw849\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.851523 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.851480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-token\") pod \"e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") " pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:32.875584 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:32.875562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:33.165722 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:33.165699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"]
Sep 09 16:14:33.167848 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:14:33.167821    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f08bde_1dbd_4aae_bf92_02d1a9b554f6.slice/crio-20cc74a7b8f4dcd2b61986e49ee5cf9697ec39033d7ef71ffd8f11dd01d3af70 WatchSource:0}: Error finding container 20cc74a7b8f4dcd2b61986e49ee5cf9697ec39033d7ef71ffd8f11dd01d3af70: Status 404 returned error can't find the container with id 20cc74a7b8f4dcd2b61986e49ee5cf9697ec39033d7ef71ffd8f11dd01d3af70
Sep 09 16:14:33.170488 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:33.170452    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:14:33.170604 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:33.170517    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:14:33.170604 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:33.170548    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:14:34.017033 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:34.016992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" event={"ID":"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6","Type":"ContainerStarted","Data":"792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"}
Sep 09 16:14:34.017452 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:34.017065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" event={"ID":"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6","Type":"ContainerStarted","Data":"20cc74a7b8f4dcd2b61986e49ee5cf9697ec39033d7ef71ffd8f11dd01d3af70"}
Sep 09 16:14:34.037888 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:34.037843    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podStartSLOduration=2.037828286 podStartE2EDuration="2.037828286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:34.036421211 +0000 UTC m=+1385.297550389" watchObservedRunningTime="2026-09-09 16:14:34.037828286 +0000 UTC m=+1385.298957461"
Sep 09 16:14:34.876010 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:34.875981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:34.881002 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:34.880973    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:35.023269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:35.023242    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:35.024005 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:35.023984    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:37.227632 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.227603    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"]
Sep 09 16:14:37.231946 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.231375    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.234091 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.234068    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-13d59f-serving-cert\""
Sep 09 16:14:37.243822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.243802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"]
Sep 09 16:14:37.389378 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.389330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc2ed4-52e8-4158-b6f7-9e358fde5832-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.389534 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.389439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhqj\" (UniqueName: \"kubernetes.io/projected/23bc2ed4-52e8-4158-b6f7-9e358fde5832-kube-api-access-qfhqj\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.389534 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.389494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.389610 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.389549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.490761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.490679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc2ed4-52e8-4158-b6f7-9e358fde5832-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.490761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.490733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhqj\" (UniqueName: \"kubernetes.io/projected/23bc2ed4-52e8-4158-b6f7-9e358fde5832-kube-api-access-qfhqj\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.490979 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.490861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.490979 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.490930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.491525 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.491502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc2ed4-52e8-4158-b6f7-9e358fde5832-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.493289 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.493262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.493407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.493391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.498510 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.498489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhqj\" (UniqueName: \"kubernetes.io/projected/23bc2ed4-52e8-4158-b6f7-9e358fde5832-kube-api-access-qfhqj\") pod \"maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.544780 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.544755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:37.826293 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:37.826267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"]
Sep 09 16:14:37.827808 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:14:37.827767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bc2ed4_52e8_4158_b6f7_9e358fde5832.slice/crio-bb13761bd3182056fa23f03b2bca141bc52fda0824a8b5a882532d296a3fd81e WatchSource:0}: Error finding container bb13761bd3182056fa23f03b2bca141bc52fda0824a8b5a882532d296a3fd81e: Status 404 returned error can't find the container with id bb13761bd3182056fa23f03b2bca141bc52fda0824a8b5a882532d296a3fd81e
Sep 09 16:14:38.040759 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.040727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q" event={"ID":"23bc2ed4-52e8-4158-b6f7-9e358fde5832","Type":"ContainerStarted","Data":"bb13761bd3182056fa23f03b2bca141bc52fda0824a8b5a882532d296a3fd81e"}
Sep 09 16:14:38.226445 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.226406    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"]
Sep 09 16:14:38.230620 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.230593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.232956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.232930    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-b0ce96-serving-cert\""
Sep 09 16:14:38.243244 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.242208    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"]
Sep 09 16:14:38.298518 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.298495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.298624 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.298541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5ht2\" (UniqueName: \"kubernetes.io/projected/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-kube-api-access-x5ht2\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.298687 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.298666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.298728 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.298706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.399256 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.399226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.399435 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.399262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.399435 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.399316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.399435 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.399361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5ht2\" (UniqueName: \"kubernetes.io/projected/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-kube-api-access-x5ht2\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.399581 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:14:38.399452    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-serving-cert: secret "maas-api-e2e-shared-a-w2-b0ce96-serving-cert" not found
Sep 09 16:14:38.399581 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:14:38.399520    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls podName:9ee62510-6b73-48ee-9831-3cdacd7e4cbb nodeName:}" failed. No retries permitted until 2026-09-09 16:14:38.899500315 +0000 UTC m=+1390.160629480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls") pod "maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" (UID: "9ee62510-6b73-48ee-9831-3cdacd7e4cbb") : secret "maas-api-e2e-shared-a-w2-b0ce96-serving-cert" not found
Sep 09 16:14:38.400003 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.399968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.401537 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.401521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.407649 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.407625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5ht2\" (UniqueName: \"kubernetes.io/projected/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-kube-api-access-x5ht2\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.904012 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.903982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:38.906483 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:38.906459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:39.048431 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:39.048386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q" event={"ID":"23bc2ed4-52e8-4158-b6f7-9e358fde5832","Type":"ContainerStarted","Data":"f8520d443216754d992375a7cd0f57be82f1578536ac997b2138eb0851e40d43"}
Sep 09 16:14:39.048618 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:39.048472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:39.066101 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:39.066052    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q" podStartSLOduration=1.638747299 podStartE2EDuration="2.066033624s" totalImagesPullingTime="427.286325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:39.065503508 +0000 UTC m=+1390.326632682" watchObservedRunningTime="2026-09-09 16:14:39.066033624 +0000 UTC m=+1390.327162801"
Sep 09 16:14:39.145190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:39.145163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:39.428425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:39.426129    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"]
Sep 09 16:14:39.430923 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:14:39.430895    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee62510_6b73_48ee_9831_3cdacd7e4cbb.slice/crio-3e3d74c25e1f5f9668c589a4c34bb5c4a35584df3b1917aa6d1564736e30ba2e WatchSource:0}: Error finding container 3e3d74c25e1f5f9668c589a4c34bb5c4a35584df3b1917aa6d1564736e30ba2e: Status 404 returned error can't find the container with id 3e3d74c25e1f5f9668c589a4c34bb5c4a35584df3b1917aa6d1564736e30ba2e
Sep 09 16:14:40.055158 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:40.055069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" event={"ID":"9ee62510-6b73-48ee-9831-3cdacd7e4cbb","Type":"ContainerStarted","Data":"7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88"}
Sep 09 16:14:40.055158 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:40.055129    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" event={"ID":"9ee62510-6b73-48ee-9831-3cdacd7e4cbb","Type":"ContainerStarted","Data":"3e3d74c25e1f5f9668c589a4c34bb5c4a35584df3b1917aa6d1564736e30ba2e"}
Sep 09 16:14:40.055403 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:40.055388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:40.074305 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:40.074256    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" podStartSLOduration=1.774244733 podStartE2EDuration="2.074238711s" totalImagesPullingTime="299.993978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:40.072048482 +0000 UTC m=+1391.333177660" watchObservedRunningTime="2026-09-09 16:14:40.074238711 +0000 UTC m=+1391.335367889"
Sep 09 16:14:45.061484 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:45.061449    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:14:46.066624 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:46.066592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:14:51.065503 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:51.065466    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 16:14:51.066032 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:51.065532    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 16:14:53.138910 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:53.138815    2578 generic.go:356] "Generic (PLEG): container finished" podID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerID="792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d" exitCode=0
Sep 09 16:14:53.138910 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:53.138891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" event={"ID":"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6","Type":"ContainerDied","Data":"792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"}
Sep 09 16:14:53.139389 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:53.139251    2578 scope.go:117] "RemoveContainer" containerID="792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"
Sep 09 16:14:53.140235 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:53.140206    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:14:53.140315 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:53.140301    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:14:53.140374 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:53.140338    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:14:54.150369 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:54.150311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" event={"ID":"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6","Type":"ContainerStarted","Data":"ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552"}
Sep 09 16:14:54.876044 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:54.876006    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:54.876244 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:54.876131    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 16:14:54.876244 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:54.876206    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 16:14:55.876869 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:55.876824    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 16:14:55.877383 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:55.876909    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 16:14:56.876827 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:56.876792    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 16:14:56.877104 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:56.877076    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 16:14:57.876949 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:57.876915    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 16:14:57.877652 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:57.877223    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 16:14:58.876301 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:58.876266    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 09 16:14:58.876593 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:58.876568    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 09 16:14:59.879967 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:59.879938    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:59.880374 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:59.880215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:14:59.880890 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:14:59.880870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:15:06.231011 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.230967    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"]
Sep 09 16:15:06.233977 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.233949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.236539 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.236518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-008161-serving-cert\""
Sep 09 16:15:06.247583 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.247558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"]
Sep 09 16:15:06.358495 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.358457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89btz\" (UniqueName: \"kubernetes.io/projected/0089116b-25dc-411c-aa57-0364fe514324-kube-api-access-89btz\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.358661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.358517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0089116b-25dc-411c-aa57-0364fe514324-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.358661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.358601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.358661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.358658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.459550 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.459517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89btz\" (UniqueName: \"kubernetes.io/projected/0089116b-25dc-411c-aa57-0364fe514324-kube-api-access-89btz\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.459550 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.459554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0089116b-25dc-411c-aa57-0364fe514324-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.459768 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.459741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.459832 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.459817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.459964 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:15:06.459945    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-serving-cert: secret "maas-api-e2e-shared-b-w2-008161-serving-cert" not found
Sep 09 16:15:06.460025 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:15:06.460013    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls podName:0089116b-25dc-411c-aa57-0364fe514324 nodeName:}" failed. No retries permitted until 2026-09-09 16:15:06.959991578 +0000 UTC m=+1418.221120735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls") pod "maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" (UID: "0089116b-25dc-411c-aa57-0364fe514324") : secret "maas-api-e2e-shared-b-w2-008161-serving-cert" not found
Sep 09 16:15:06.460151 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.460133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0089116b-25dc-411c-aa57-0364fe514324-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.462148 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.462131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.470475 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.470453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89btz\" (UniqueName: \"kubernetes.io/projected/0089116b-25dc-411c-aa57-0364fe514324-kube-api-access-89btz\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.881868 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.881836    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"]
Sep 09 16:15:06.884661 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.884644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:06.887335 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.887302    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-008161\""
Sep 09 16:15:06.897176 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.897154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"]
Sep 09 16:15:06.964477 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.964446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlx7q\" (UniqueName: \"kubernetes.io/projected/c4747367-6d2f-4704-a931-94b9dea7a20c-kube-api-access-wlx7q\") pod \"payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:06.964586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.964532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4747367-6d2f-4704-a931-94b9dea7a20c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:06.964586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.964576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:06.966835 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:06.966815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:07.066228 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.066192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4747367-6d2f-4704-a931-94b9dea7a20c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:07.066414 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.066325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlx7q\" (UniqueName: \"kubernetes.io/projected/c4747367-6d2f-4704-a931-94b9dea7a20c-kube-api-access-wlx7q\") pod \"payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:07.066906 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.066888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4747367-6d2f-4704-a931-94b9dea7a20c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:07.074277 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.074247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlx7q\" (UniqueName: \"kubernetes.io/projected/c4747367-6d2f-4704-a931-94b9dea7a20c-kube-api-access-wlx7q\") pod \"payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:07.146421 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.146335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:07.196529 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.196487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:07.423041 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.423018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"]
Sep 09 16:15:07.424682 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:15:07.424653    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0089116b_25dc_411c_aa57_0364fe514324.slice/crio-709ac7b2f75ca9537d7e018015eda4da502db04cf0ec7df2f996b58c576b4479 WatchSource:0}: Error finding container 709ac7b2f75ca9537d7e018015eda4da502db04cf0ec7df2f996b58c576b4479: Status 404 returned error can't find the container with id 709ac7b2f75ca9537d7e018015eda4da502db04cf0ec7df2f996b58c576b4479
Sep 09 16:15:07.484815 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:07.484791    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"]
Sep 09 16:15:07.485282 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:15:07.485249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4747367_6d2f_4704_a931_94b9dea7a20c.slice/crio-dd190119cfe04e8a6f1c06fa4a93e4a9dad434cb4bb76006685668cb3c0bbadc WatchSource:0}: Error finding container dd190119cfe04e8a6f1c06fa4a93e4a9dad434cb4bb76006685668cb3c0bbadc: Status 404 returned error can't find the container with id dd190119cfe04e8a6f1c06fa4a93e4a9dad434cb4bb76006685668cb3c0bbadc
Sep 09 16:15:08.244546 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.244509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" event={"ID":"0089116b-25dc-411c-aa57-0364fe514324","Type":"ContainerStarted","Data":"841be8f7775d687de2d942458b656b30864c209aeca460975128901e70f7d3a5"}
Sep 09 16:15:08.244763 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.244572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" event={"ID":"0089116b-25dc-411c-aa57-0364fe514324","Type":"ContainerStarted","Data":"709ac7b2f75ca9537d7e018015eda4da502db04cf0ec7df2f996b58c576b4479"}
Sep 09 16:15:08.244763 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.244623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:08.246248 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.246222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt" event={"ID":"c4747367-6d2f-4704-a931-94b9dea7a20c","Type":"ContainerStarted","Data":"4dbcf2943ead2bd687801dd2af69442d89e8490d10596eceb39c1ee55377185c"}
Sep 09 16:15:08.246387 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.246261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt" event={"ID":"c4747367-6d2f-4704-a931-94b9dea7a20c","Type":"ContainerStarted","Data":"dd190119cfe04e8a6f1c06fa4a93e4a9dad434cb4bb76006685668cb3c0bbadc"}
Sep 09 16:15:08.246387 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.246296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:08.263937 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.263894    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" podStartSLOduration=1.934541552 podStartE2EDuration="2.263879666s" totalImagesPullingTime="329.338114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:15:08.26265003 +0000 UTC m=+1419.523779210" watchObservedRunningTime="2026-09-09 16:15:08.263879666 +0000 UTC m=+1419.525008864"
Sep 09 16:15:08.280238 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:08.280200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt" podStartSLOduration=2.280188316 podStartE2EDuration="2.280188316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:15:08.278253674 +0000 UTC m=+1419.539382850" watchObservedRunningTime="2026-09-09 16:15:08.280188316 +0000 UTC m=+1419.541317491"
Sep 09 16:15:14.257816 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:14.257790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:15:19.253690 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:19.253663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:15:44.555646 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.555564    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"]
Sep 09 16:15:44.561070 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.561047    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.563619 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.563594    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4c4ad334-serving-cert\""
Sep 09 16:15:44.572487 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.572463    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"]
Sep 09 16:15:44.692990 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.692945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtljd\" (UniqueName: \"kubernetes.io/projected/87387e4f-8b4b-4647-8171-dfe1d71eb41d-kube-api-access-vtljd\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.693146 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.693052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-metrics-certs\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.693204 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.693184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-maas-api-tls\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.693261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.693246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87387e4f-8b4b-4647-8171-dfe1d71eb41d-openshift-service-ca\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.793727 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.793695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-maas-api-tls\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.793881 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.793736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87387e4f-8b4b-4647-8171-dfe1d71eb41d-openshift-service-ca\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.793881 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.793857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtljd\" (UniqueName: \"kubernetes.io/projected/87387e4f-8b4b-4647-8171-dfe1d71eb41d-kube-api-access-vtljd\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.793971 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.793912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-metrics-certs\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.794398 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.794375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87387e4f-8b4b-4647-8171-dfe1d71eb41d-openshift-service-ca\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.796103 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.796080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-metrics-certs\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.796202 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.796170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-maas-api-tls\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.803331 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.803303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtljd\" (UniqueName: \"kubernetes.io/projected/87387e4f-8b4b-4647-8171-dfe1d71eb41d-kube-api-access-vtljd\") pod \"maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:44.873448 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:44.873374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:45.150825 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:45.150800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"]
Sep 09 16:15:45.152801 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:15:45.152772    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87387e4f_8b4b_4647_8171_dfe1d71eb41d.slice/crio-ee3fb5c4f51309202fc89789ab3006114011b61c2859a4cb96a5598eba247543 WatchSource:0}: Error finding container ee3fb5c4f51309202fc89789ab3006114011b61c2859a4cb96a5598eba247543: Status 404 returned error can't find the container with id ee3fb5c4f51309202fc89789ab3006114011b61c2859a4cb96a5598eba247543
Sep 09 16:15:45.469679 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:45.469647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv" event={"ID":"87387e4f-8b4b-4647-8171-dfe1d71eb41d","Type":"ContainerStarted","Data":"ee3fb5c4f51309202fc89789ab3006114011b61c2859a4cb96a5598eba247543"}
Sep 09 16:15:49.494984 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:49.494944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv" event={"ID":"87387e4f-8b4b-4647-8171-dfe1d71eb41d","Type":"ContainerStarted","Data":"57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a"}
Sep 09 16:15:49.495378 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:49.495012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:15:49.513446 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:49.513401    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv" podStartSLOduration=2.01382708 podStartE2EDuration="5.513385783s" totalImagesPullingTime="3.499558703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:15:49.510903368 +0000 UTC m=+1460.772032543" watchObservedRunningTime="2026-09-09 16:15:49.513385783 +0000 UTC m=+1460.774514958"
Sep 09 16:15:55.507156 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:15:55.507126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:17:29.294042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.294010    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"]
Sep 09 16:17:29.294665 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.294231    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv" podUID="87387e4f-8b4b-4647-8171-dfe1d71eb41d" containerName="maas-api" containerID="cri-o://57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a" gracePeriod=30
Sep 09 16:17:29.560434 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.560411    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:17:29.654925 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.654898    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87387e4f-8b4b-4647-8171-dfe1d71eb41d-openshift-service-ca\") pod \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") "
Sep 09 16:17:29.655123 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.655001    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-metrics-certs\") pod \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") "
Sep 09 16:17:29.655123 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.655028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtljd\" (UniqueName: \"kubernetes.io/projected/87387e4f-8b4b-4647-8171-dfe1d71eb41d-kube-api-access-vtljd\") pod \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") "
Sep 09 16:17:29.655123 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.655082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-maas-api-tls\") pod \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\" (UID: \"87387e4f-8b4b-4647-8171-dfe1d71eb41d\") "
Sep 09 16:17:29.655304 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.655271    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87387e4f-8b4b-4647-8171-dfe1d71eb41d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87387e4f-8b4b-4647-8171-dfe1d71eb41d" (UID: "87387e4f-8b4b-4647-8171-dfe1d71eb41d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:17:29.655460 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.655440    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87387e4f-8b4b-4647-8171-dfe1d71eb41d-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:17:29.657331 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.657302    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87387e4f-8b4b-4647-8171-dfe1d71eb41d-kube-api-access-vtljd" (OuterVolumeSpecName: "kube-api-access-vtljd") pod "87387e4f-8b4b-4647-8171-dfe1d71eb41d" (UID: "87387e4f-8b4b-4647-8171-dfe1d71eb41d"). InnerVolumeSpecName "kube-api-access-vtljd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:17:29.657594 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.657555    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "87387e4f-8b4b-4647-8171-dfe1d71eb41d" (UID: "87387e4f-8b4b-4647-8171-dfe1d71eb41d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:17:29.657806 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.657782    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87387e4f-8b4b-4647-8171-dfe1d71eb41d" (UID: "87387e4f-8b4b-4647-8171-dfe1d71eb41d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:17:29.756510 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.756483    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:17:29.756510 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.756505    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtljd\" (UniqueName: \"kubernetes.io/projected/87387e4f-8b4b-4647-8171-dfe1d71eb41d-kube-api-access-vtljd\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:17:29.756510 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:29.756514    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87387e4f-8b4b-4647-8171-dfe1d71eb41d-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:17:30.093473 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.093430    2578 generic.go:356] "Generic (PLEG): container finished" podID="87387e4f-8b4b-4647-8171-dfe1d71eb41d" containerID="57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a" exitCode=0
Sep 09 16:17:30.093644 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.093479    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"
Sep 09 16:17:30.093644 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.093527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv" event={"ID":"87387e4f-8b4b-4647-8171-dfe1d71eb41d","Type":"ContainerDied","Data":"57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a"}
Sep 09 16:17:30.093644 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.093583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv" event={"ID":"87387e4f-8b4b-4647-8171-dfe1d71eb41d","Type":"ContainerDied","Data":"ee3fb5c4f51309202fc89789ab3006114011b61c2859a4cb96a5598eba247543"}
Sep 09 16:17:30.093644 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.093611    2578 scope.go:117] "RemoveContainer" containerID="57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a"
Sep 09 16:17:30.104115 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.104096    2578 scope.go:117] "RemoveContainer" containerID="57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a"
Sep 09 16:17:30.104408 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:17:30.104387    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a\": container with ID starting with 57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a not found: ID does not exist" containerID="57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a"
Sep 09 16:17:30.104499 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.104416    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a"} err="failed to get container status \"57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a\": rpc error: code = NotFound desc = could not find container \"57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a\": container with ID starting with 57296be9fc12191680f15aeeb520be90c06232eb54b5f4dcd9b8fdd51e1b4d1a not found: ID does not exist"
Sep 09 16:17:30.116330 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.116307    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"]
Sep 09 16:17:30.120663 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:30.120642    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4c4ad334-8469d88df-4kjwv"]
Sep 09 16:17:31.369376 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:17:31.369328    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87387e4f-8b4b-4647-8171-dfe1d71eb41d" path="/var/lib/kubelet/pods/87387e4f-8b4b-4647-8171-dfe1d71eb41d/volumes"
Sep 09 16:19:19.895750 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.895715    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"]
Sep 09 16:19:19.896384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.896366    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87387e4f-8b4b-4647-8171-dfe1d71eb41d" containerName="maas-api"
Sep 09 16:19:19.896476 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.896386    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87387e4f-8b4b-4647-8171-dfe1d71eb41d" containerName="maas-api"
Sep 09 16:19:19.896535 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.896513    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87387e4f-8b4b-4647-8171-dfe1d71eb41d" containerName="maas-api"
Sep 09 16:19:19.899720 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.899702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:19.903773 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.903748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-94cf14-serving-cert\""
Sep 09 16:19:19.910916 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:19.910894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"]
Sep 09 16:19:20.010400 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.010336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-metrics-certs\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.010576 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.010466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb6sk\" (UniqueName: \"kubernetes.io/projected/441dee43-26d0-41ac-8630-87d55b25b933-kube-api-access-fb6sk\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.010576 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.010562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.010659 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.010583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/441dee43-26d0-41ac-8630-87d55b25b933-openshift-service-ca\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.111456 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.111423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-metrics-certs\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.111617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.111486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb6sk\" (UniqueName: \"kubernetes.io/projected/441dee43-26d0-41ac-8630-87d55b25b933-kube-api-access-fb6sk\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.111617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.111565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.111617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.111595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/441dee43-26d0-41ac-8630-87d55b25b933-openshift-service-ca\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.111846 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:19:20.111797    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-serving-cert: secret "maas-api-e2e-api-a-94cf14-serving-cert" not found
Sep 09 16:19:20.111964 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:19:20.111889    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls podName:441dee43-26d0-41ac-8630-87d55b25b933 nodeName:}" failed. No retries permitted until 2026-09-09 16:19:20.611865719 +0000 UTC m=+1671.872994873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls") pod "maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" (UID: "441dee43-26d0-41ac-8630-87d55b25b933") : secret "maas-api-e2e-api-a-94cf14-serving-cert" not found
Sep 09 16:19:20.112369 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.112335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/441dee43-26d0-41ac-8630-87d55b25b933-openshift-service-ca\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.114084 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.114061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-metrics-certs\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.132504 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.132479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb6sk\" (UniqueName: \"kubernetes.io/projected/441dee43-26d0-41ac-8630-87d55b25b933-kube-api-access-fb6sk\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.615882 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.615850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.618099 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.618070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls\") pod \"maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:20.812119 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:20.812087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:21.086748 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:21.086719    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"]
Sep 09 16:19:21.088341 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:19:21.088314    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441dee43_26d0_41ac_8630_87d55b25b933.slice/crio-802d8db9506ec53aea2c224cae10c66042ee8551897db4b892ee339086911384 WatchSource:0}: Error finding container 802d8db9506ec53aea2c224cae10c66042ee8551897db4b892ee339086911384: Status 404 returned error can't find the container with id 802d8db9506ec53aea2c224cae10c66042ee8551897db4b892ee339086911384
Sep 09 16:19:21.089743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:21.089726    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:19:21.747262 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:21.747173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" event={"ID":"441dee43-26d0-41ac-8630-87d55b25b933","Type":"ContainerStarted","Data":"d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c"}
Sep 09 16:19:21.747262 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:21.747233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" event={"ID":"441dee43-26d0-41ac-8630-87d55b25b933","Type":"ContainerStarted","Data":"802d8db9506ec53aea2c224cae10c66042ee8551897db4b892ee339086911384"}
Sep 09 16:19:21.747476 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:21.747312    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:21.767456 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:21.767412    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" podStartSLOduration=2.363892638 podStartE2EDuration="2.767398827s" totalImagesPullingTime="403.506189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:21.76596063 +0000 UTC m=+1673.027089806" watchObservedRunningTime="2026-09-09 16:19:21.767398827 +0000 UTC m=+1673.028528003"
Sep 09 16:19:27.758418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:27.758389    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:19:49.043507 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.043472    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"]
Sep 09 16:19:49.048049 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.048027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.054456 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.054424    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-07cc17-serving-cert\""
Sep 09 16:19:49.064748 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.064729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"]
Sep 09 16:19:49.077761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.077739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-metrics-certs\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.077851 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.077810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwlpb\" (UniqueName: \"kubernetes.io/projected/fa083696-d564-4142-8ceb-ce77c5bc6841-kube-api-access-cwlpb\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.077977 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.077861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.077977 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.077915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa083696-d564-4142-8ceb-ce77c5bc6841-openshift-service-ca\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.178489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.178459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-metrics-certs\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.178682 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.178525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwlpb\" (UniqueName: \"kubernetes.io/projected/fa083696-d564-4142-8ceb-ce77c5bc6841-kube-api-access-cwlpb\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.178682 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.178556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.178682 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.178576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa083696-d564-4142-8ceb-ce77c5bc6841-openshift-service-ca\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.178868 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:19:49.178688    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-serving-cert: secret "maas-api-e2e-api-b-07cc17-serving-cert" not found
Sep 09 16:19:49.178868 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:19:49.178775    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls podName:fa083696-d564-4142-8ceb-ce77c5bc6841 nodeName:}" failed. No retries permitted until 2026-09-09 16:19:49.678750581 +0000 UTC m=+1700.939879737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls") pod "maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" (UID: "fa083696-d564-4142-8ceb-ce77c5bc6841") : secret "maas-api-e2e-api-b-07cc17-serving-cert" not found
Sep 09 16:19:49.179344 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.179326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa083696-d564-4142-8ceb-ce77c5bc6841-openshift-service-ca\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.181116 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.181093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-metrics-certs\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.192051 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.192029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwlpb\" (UniqueName: \"kubernetes.io/projected/fa083696-d564-4142-8ceb-ce77c5bc6841-kube-api-access-cwlpb\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.683453 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.683416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.685831 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.685803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls\") pod \"maas-api-e2e-api-b-07cc17-869557b59b-7gbp2\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:49.958743 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:49.958714    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:50.247038 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:50.247015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"]
Sep 09 16:19:50.248376 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:19:50.248335    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa083696_d564_4142_8ceb_ce77c5bc6841.slice/crio-6dde0f6e831e10216d91cfc23afcdde79bb75688b2bc5813bc0acef4e9dac1b8 WatchSource:0}: Error finding container 6dde0f6e831e10216d91cfc23afcdde79bb75688b2bc5813bc0acef4e9dac1b8: Status 404 returned error can't find the container with id 6dde0f6e831e10216d91cfc23afcdde79bb75688b2bc5813bc0acef4e9dac1b8
Sep 09 16:19:50.919593 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:50.919558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" event={"ID":"fa083696-d564-4142-8ceb-ce77c5bc6841","Type":"ContainerStarted","Data":"928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366"}
Sep 09 16:19:50.919762 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:50.919608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" event={"ID":"fa083696-d564-4142-8ceb-ce77c5bc6841","Type":"ContainerStarted","Data":"6dde0f6e831e10216d91cfc23afcdde79bb75688b2bc5813bc0acef4e9dac1b8"}
Sep 09 16:19:50.919762 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:50.919677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:19:50.938385 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:50.938328    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" podStartSLOduration=1.44533384 podStartE2EDuration="1.938314024s" totalImagesPullingTime="492.980184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:50.935629305 +0000 UTC m=+1702.196758482" watchObservedRunningTime="2026-09-09 16:19:50.938314024 +0000 UTC m=+1702.199443200"
Sep 09 16:19:56.929990 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:19:56.929958    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:20:31.299010 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.298972    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"]
Sep 09 16:20:31.299636 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.299239    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" podUID="441dee43-26d0-41ac-8630-87d55b25b933" containerName="maas-api" containerID="cri-o://d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c" gracePeriod=30
Sep 09 16:20:31.545590 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.545567    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:20:31.669305 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.669244    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb6sk\" (UniqueName: \"kubernetes.io/projected/441dee43-26d0-41ac-8630-87d55b25b933-kube-api-access-fb6sk\") pod \"441dee43-26d0-41ac-8630-87d55b25b933\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") "
Sep 09 16:20:31.669305 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.669280    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-metrics-certs\") pod \"441dee43-26d0-41ac-8630-87d55b25b933\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") "
Sep 09 16:20:31.669537 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.669315    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/441dee43-26d0-41ac-8630-87d55b25b933-openshift-service-ca\") pod \"441dee43-26d0-41ac-8630-87d55b25b933\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") "
Sep 09 16:20:31.669537 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.669390    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls\") pod \"441dee43-26d0-41ac-8630-87d55b25b933\" (UID: \"441dee43-26d0-41ac-8630-87d55b25b933\") "
Sep 09 16:20:31.669710 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.669679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/441dee43-26d0-41ac-8630-87d55b25b933-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "441dee43-26d0-41ac-8630-87d55b25b933" (UID: "441dee43-26d0-41ac-8630-87d55b25b933"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:31.674183 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.673993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "441dee43-26d0-41ac-8630-87d55b25b933" (UID: "441dee43-26d0-41ac-8630-87d55b25b933"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:31.674183 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.674124    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "441dee43-26d0-41ac-8630-87d55b25b933" (UID: "441dee43-26d0-41ac-8630-87d55b25b933"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:31.679695 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.679665    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/441dee43-26d0-41ac-8630-87d55b25b933-kube-api-access-fb6sk" (OuterVolumeSpecName: "kube-api-access-fb6sk") pod "441dee43-26d0-41ac-8630-87d55b25b933" (UID: "441dee43-26d0-41ac-8630-87d55b25b933"). InnerVolumeSpecName "kube-api-access-fb6sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:31.770936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.770910    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/441dee43-26d0-41ac-8630-87d55b25b933-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:31.770936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.770936    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:31.771089 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.770945    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb6sk\" (UniqueName: \"kubernetes.io/projected/441dee43-26d0-41ac-8630-87d55b25b933-kube-api-access-fb6sk\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:31.771089 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:31.770955    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/441dee43-26d0-41ac-8630-87d55b25b933-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:32.164248 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.164213    2578 generic.go:356] "Generic (PLEG): container finished" podID="441dee43-26d0-41ac-8630-87d55b25b933" containerID="d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c" exitCode=0
Sep 09 16:20:32.164430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.164255    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"
Sep 09 16:20:32.164430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.164298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" event={"ID":"441dee43-26d0-41ac-8630-87d55b25b933","Type":"ContainerDied","Data":"d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c"}
Sep 09 16:20:32.164430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.164345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6" event={"ID":"441dee43-26d0-41ac-8630-87d55b25b933","Type":"ContainerDied","Data":"802d8db9506ec53aea2c224cae10c66042ee8551897db4b892ee339086911384"}
Sep 09 16:20:32.164430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.164386    2578 scope.go:117] "RemoveContainer" containerID="d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c"
Sep 09 16:20:32.176624 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.176599    2578 scope.go:117] "RemoveContainer" containerID="d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c"
Sep 09 16:20:32.176948 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:20:32.176922    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c\": container with ID starting with d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c not found: ID does not exist" containerID="d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c"
Sep 09 16:20:32.177041 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.176967    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c"} err="failed to get container status \"d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c\": rpc error: code = NotFound desc = could not find container \"d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c\": container with ID starting with d8d647cb38765e23aab92811c04fd555846cde4f19f12341a6ad5d5cbc95987c not found: ID does not exist"
Sep 09 16:20:32.191062 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.191039    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"]
Sep 09 16:20:32.193832 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:32.193811    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94cf14-5459cd4759-q7cq6"]
Sep 09 16:20:33.368484 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:33.368451    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="441dee43-26d0-41ac-8630-87d55b25b933" path="/var/lib/kubelet/pods/441dee43-26d0-41ac-8630-87d55b25b933/volumes"
Sep 09 16:20:53.947034 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:53.946927    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"]
Sep 09 16:20:53.947641 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:53.947180    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" podUID="fa083696-d564-4142-8ceb-ce77c5bc6841" containerName="maas-api" containerID="cri-o://928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366" gracePeriod=30
Sep 09 16:20:54.196586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.196560    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:20:54.297928 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.297896    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa083696-d564-4142-8ceb-ce77c5bc6841" containerID="928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366" exitCode=0
Sep 09 16:20:54.298057 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.297941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"
Sep 09 16:20:54.298057 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.297981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" event={"ID":"fa083696-d564-4142-8ceb-ce77c5bc6841","Type":"ContainerDied","Data":"928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366"}
Sep 09 16:20:54.298057 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.298038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2" event={"ID":"fa083696-d564-4142-8ceb-ce77c5bc6841","Type":"ContainerDied","Data":"6dde0f6e831e10216d91cfc23afcdde79bb75688b2bc5813bc0acef4e9dac1b8"}
Sep 09 16:20:54.298177 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.298066    2578 scope.go:117] "RemoveContainer" containerID="928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366"
Sep 09 16:20:54.307819 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.307804    2578 scope.go:117] "RemoveContainer" containerID="928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366"
Sep 09 16:20:54.308099 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:20:54.308074    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366\": container with ID starting with 928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366 not found: ID does not exist" containerID="928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366"
Sep 09 16:20:54.308177 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.308106    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366"} err="failed to get container status \"928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366\": rpc error: code = NotFound desc = could not find container \"928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366\": container with ID starting with 928c1221f2a9a2808bfe517fcf98942261489bc0a539490c813f3344d446b366 not found: ID does not exist"
Sep 09 16:20:54.365708 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.365679    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-metrics-certs\") pod \"fa083696-d564-4142-8ceb-ce77c5bc6841\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") "
Sep 09 16:20:54.365878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.365732    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls\") pod \"fa083696-d564-4142-8ceb-ce77c5bc6841\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") "
Sep 09 16:20:54.365878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.365816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwlpb\" (UniqueName: \"kubernetes.io/projected/fa083696-d564-4142-8ceb-ce77c5bc6841-kube-api-access-cwlpb\") pod \"fa083696-d564-4142-8ceb-ce77c5bc6841\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") "
Sep 09 16:20:54.365878 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.365878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa083696-d564-4142-8ceb-ce77c5bc6841-openshift-service-ca\") pod \"fa083696-d564-4142-8ceb-ce77c5bc6841\" (UID: \"fa083696-d564-4142-8ceb-ce77c5bc6841\") "
Sep 09 16:20:54.366540 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.366506    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa083696-d564-4142-8ceb-ce77c5bc6841-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa083696-d564-4142-8ceb-ce77c5bc6841" (UID: "fa083696-d564-4142-8ceb-ce77c5bc6841"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:54.368490 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.368467    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fa083696-d564-4142-8ceb-ce77c5bc6841" (UID: "fa083696-d564-4142-8ceb-ce77c5bc6841"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:54.368597 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.368464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa083696-d564-4142-8ceb-ce77c5bc6841" (UID: "fa083696-d564-4142-8ceb-ce77c5bc6841"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:54.368597 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.368510    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa083696-d564-4142-8ceb-ce77c5bc6841-kube-api-access-cwlpb" (OuterVolumeSpecName: "kube-api-access-cwlpb") pod "fa083696-d564-4142-8ceb-ce77c5bc6841" (UID: "fa083696-d564-4142-8ceb-ce77c5bc6841"). InnerVolumeSpecName "kube-api-access-cwlpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:54.467296 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.467268    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwlpb\" (UniqueName: \"kubernetes.io/projected/fa083696-d564-4142-8ceb-ce77c5bc6841-kube-api-access-cwlpb\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:54.467296 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.467291    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa083696-d564-4142-8ceb-ce77c5bc6841-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:54.467468 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.467301    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:54.467468 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.467310    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa083696-d564-4142-8ceb-ce77c5bc6841-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:20:54.620821 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.620797    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"]
Sep 09 16:20:54.624233 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:54.624208    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-07cc17-869557b59b-7gbp2"]
Sep 09 16:20:55.368276 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:20:55.368234    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa083696-d564-4142-8ceb-ce77c5bc6841" path="/var/lib/kubelet/pods/fa083696-d564-4142-8ceb-ce77c5bc6841/volumes"
Sep 09 16:21:11.406669 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.406626    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"]
Sep 09 16:21:11.407277 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.406839    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" podUID="9ee62510-6b73-48ee-9831-3cdacd7e4cbb" containerName="maas-api" containerID="cri-o://7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88" gracePeriod=30
Sep 09 16:21:11.657234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.657177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:21:11.723812 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.723787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5ht2\" (UniqueName: \"kubernetes.io/projected/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-kube-api-access-x5ht2\") pod \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") "
Sep 09 16:21:11.723944 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.723824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-openshift-service-ca\") pod \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") "
Sep 09 16:21:11.723944 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.723872    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-metrics-certs\") pod \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") "
Sep 09 16:21:11.723944 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.723895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls\") pod \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\" (UID: \"9ee62510-6b73-48ee-9831-3cdacd7e4cbb\") "
Sep 09 16:21:11.724210 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.724186    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ee62510-6b73-48ee-9831-3cdacd7e4cbb" (UID: "9ee62510-6b73-48ee-9831-3cdacd7e4cbb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:21:11.724290 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.724258    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:11.725875 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.725845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-kube-api-access-x5ht2" (OuterVolumeSpecName: "kube-api-access-x5ht2") pod "9ee62510-6b73-48ee-9831-3cdacd7e4cbb" (UID: "9ee62510-6b73-48ee-9831-3cdacd7e4cbb"). InnerVolumeSpecName "kube-api-access-x5ht2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:21:11.725961 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.725901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ee62510-6b73-48ee-9831-3cdacd7e4cbb" (UID: "9ee62510-6b73-48ee-9831-3cdacd7e4cbb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:21:11.725961 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.725927    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9ee62510-6b73-48ee-9831-3cdacd7e4cbb" (UID: "9ee62510-6b73-48ee-9831-3cdacd7e4cbb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:21:11.825727 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.825695    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5ht2\" (UniqueName: \"kubernetes.io/projected/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-kube-api-access-x5ht2\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:11.825727 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.825723    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:11.825727 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:11.825733    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ee62510-6b73-48ee-9831-3cdacd7e4cbb-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:12.408803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.408770    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ee62510-6b73-48ee-9831-3cdacd7e4cbb" containerID="7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88" exitCode=0
Sep 09 16:21:12.409269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.408819    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"
Sep 09 16:21:12.409269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.408822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" event={"ID":"9ee62510-6b73-48ee-9831-3cdacd7e4cbb","Type":"ContainerDied","Data":"7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88"}
Sep 09 16:21:12.409269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.408963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl" event={"ID":"9ee62510-6b73-48ee-9831-3cdacd7e4cbb","Type":"ContainerDied","Data":"3e3d74c25e1f5f9668c589a4c34bb5c4a35584df3b1917aa6d1564736e30ba2e"}
Sep 09 16:21:12.409269 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.409002    2578 scope.go:117] "RemoveContainer" containerID="7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88"
Sep 09 16:21:12.422796 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.422777    2578 scope.go:117] "RemoveContainer" containerID="7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88"
Sep 09 16:21:12.423086 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:21:12.423067    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88\": container with ID starting with 7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88 not found: ID does not exist" containerID="7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88"
Sep 09 16:21:12.423165 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.423093    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88"} err="failed to get container status \"7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88\": rpc error: code = NotFound desc = could not find container \"7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88\": container with ID starting with 7e5b5248b7207ecc4df9e060aa475fc67a096a9de38287fbb119463e616e7b88 not found: ID does not exist"
Sep 09 16:21:12.432563 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.432540    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"]
Sep 09 16:21:12.436148 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:12.436128    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b0ce96-5cd7cc7f86-jmbxl"]
Sep 09 16:21:13.368676 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:13.368643    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee62510-6b73-48ee-9831-3cdacd7e4cbb" path="/var/lib/kubelet/pods/9ee62510-6b73-48ee-9831-3cdacd7e4cbb/volumes"
Sep 09 16:21:17.914335 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:17.914305    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"]
Sep 09 16:21:17.914857 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:17.914530    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy" containerID="cri-o://ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552" gracePeriod=30
Sep 09 16:21:23.165365 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.165328    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:21:23.227198 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-certs\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227203    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-data\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227243    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-credential-socket\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227270    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-token\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227293    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-podinfo\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227384 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227374    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istiod-ca-cert\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-envoy\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw849\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-kube-api-access-gw849\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:21:23.227673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:21:23.227673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:21:23.227673 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-socket\") pod \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\" (UID: \"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6\") "
Sep 09 16:21:23.227950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:21:23.227950 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:21:23.228029 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.227980    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.228029 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.228000    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.228029 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.228013    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-credential-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.228144 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.228028    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istiod-ca-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.229630 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.229610    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-kube-api-access-gw849" (OuterVolumeSpecName: "kube-api-access-gw849") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "kube-api-access-gw849". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:21:23.229747 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.229669    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:21:23.229863 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.229844    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:21:23.229863 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.229851    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" (UID: "b6f08bde-1dbd-4aae-bf92-02d1a9b554f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:21:23.328504 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.328482    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-envoy\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.328504 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.328503    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw849\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-kube-api-access-gw849\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.328634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.328514    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-workload-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.328634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.328522    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-token\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.328634 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.328530    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6-istio-podinfo\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:23.488091 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.488022    2578 generic.go:356] "Generic (PLEG): container finished" podID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerID="ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552" exitCode=0
Sep 09 16:21:23.488091 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.488081    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"
Sep 09 16:21:23.488221 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.488109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" event={"ID":"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6","Type":"ContainerDied","Data":"ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552"}
Sep 09 16:21:23.488221 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.488162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv" event={"ID":"b6f08bde-1dbd-4aae-bf92-02d1a9b554f6","Type":"ContainerDied","Data":"20cc74a7b8f4dcd2b61986e49ee5cf9697ec39033d7ef71ffd8f11dd01d3af70"}
Sep 09 16:21:23.488221 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.488189    2578 scope.go:117] "RemoveContainer" containerID="ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552"
Sep 09 16:21:23.497471 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.497443    2578 scope.go:117] "RemoveContainer" containerID="792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"
Sep 09 16:21:23.506088 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.506018    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"]
Sep 09 16:21:23.506154 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.506121    2578 scope.go:117] "RemoveContainer" containerID="ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552"
Sep 09 16:21:23.506436 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:21:23.506418    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552\": container with ID starting with ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552 not found: ID does not exist" containerID="ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552"
Sep 09 16:21:23.506501 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.506443    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552"} err="failed to get container status \"ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552\": rpc error: code = NotFound desc = could not find container \"ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552\": container with ID starting with ce918901f9561b32c15b6e558d2260be25981c469134ca4977c65a70bcfe8552 not found: ID does not exist"
Sep 09 16:21:23.506501 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.506460    2578 scope.go:117] "RemoveContainer" containerID="792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"
Sep 09 16:21:23.506706 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:21:23.506687    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d\": container with ID starting with 792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d not found: ID does not exist" containerID="792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"
Sep 09 16:21:23.506747 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.506712    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d"} err="failed to get container status \"792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d\": rpc error: code = NotFound desc = could not find container \"792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d\": container with ID starting with 792173dfee43113af68f8ac6d86a50db5ae2337c112f129cbd4a911d21e0d65d not found: ID does not exist"
Sep 09 16:21:23.508494 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:23.508475    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv"]
Sep 09 16:21:25.368665 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:25.368637    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" path="/var/lib/kubelet/pods/b6f08bde-1dbd-4aae-bf92-02d1a9b554f6/volumes"
Sep 09 16:21:28.857902 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:28.857865    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"]
Sep 09 16:21:28.858500 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:28.858131    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" podUID="0089116b-25dc-411c-aa57-0364fe514324" containerName="maas-api" containerID="cri-o://841be8f7775d687de2d942458b656b30864c209aeca460975128901e70f7d3a5" gracePeriod=30
Sep 09 16:21:28.914184 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:28.914152    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"]
Sep 09 16:21:28.914433 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:28.914408    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt" podUID="c4747367-6d2f-4704-a931-94b9dea7a20c" containerName="payload-processing" containerID="cri-o://4dbcf2943ead2bd687801dd2af69442d89e8490d10596eceb39c1ee55377185c" gracePeriod=30
Sep 09 16:21:29.172475 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.172449    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:21:29.205835 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.205813    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:21:29.283704 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.283674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-metrics-certs\") pod \"0089116b-25dc-411c-aa57-0364fe514324\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") "
Sep 09 16:21:29.283899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.283782    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlx7q\" (UniqueName: \"kubernetes.io/projected/c4747367-6d2f-4704-a931-94b9dea7a20c-kube-api-access-wlx7q\") pod \"c4747367-6d2f-4704-a931-94b9dea7a20c\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") "
Sep 09 16:21:29.283899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.283845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0089116b-25dc-411c-aa57-0364fe514324-openshift-service-ca\") pod \"0089116b-25dc-411c-aa57-0364fe514324\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") "
Sep 09 16:21:29.283899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.283880    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls\") pod \"0089116b-25dc-411c-aa57-0364fe514324\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") "
Sep 09 16:21:29.284079 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.283921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4747367-6d2f-4704-a931-94b9dea7a20c-plugins-config-volume\") pod \"c4747367-6d2f-4704-a931-94b9dea7a20c\" (UID: \"c4747367-6d2f-4704-a931-94b9dea7a20c\") "
Sep 09 16:21:29.284079 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.283958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89btz\" (UniqueName: \"kubernetes.io/projected/0089116b-25dc-411c-aa57-0364fe514324-kube-api-access-89btz\") pod \"0089116b-25dc-411c-aa57-0364fe514324\" (UID: \"0089116b-25dc-411c-aa57-0364fe514324\") "
Sep 09 16:21:29.284667 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.284485    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4747367-6d2f-4704-a931-94b9dea7a20c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4747367-6d2f-4704-a931-94b9dea7a20c" (UID: "c4747367-6d2f-4704-a931-94b9dea7a20c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:21:29.284667 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.284662    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0089116b-25dc-411c-aa57-0364fe514324-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0089116b-25dc-411c-aa57-0364fe514324" (UID: "0089116b-25dc-411c-aa57-0364fe514324"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:21:29.284861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.284809    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0089116b-25dc-411c-aa57-0364fe514324-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:29.284861 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.284823    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4747367-6d2f-4704-a931-94b9dea7a20c-plugins-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:29.286283 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.286252    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0089116b-25dc-411c-aa57-0364fe514324" (UID: "0089116b-25dc-411c-aa57-0364fe514324"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:21:29.286776 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.286734    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0089116b-25dc-411c-aa57-0364fe514324-kube-api-access-89btz" (OuterVolumeSpecName: "kube-api-access-89btz") pod "0089116b-25dc-411c-aa57-0364fe514324" (UID: "0089116b-25dc-411c-aa57-0364fe514324"). InnerVolumeSpecName "kube-api-access-89btz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:21:29.286877 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.286849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4747367-6d2f-4704-a931-94b9dea7a20c-kube-api-access-wlx7q" (OuterVolumeSpecName: "kube-api-access-wlx7q") pod "c4747367-6d2f-4704-a931-94b9dea7a20c" (UID: "c4747367-6d2f-4704-a931-94b9dea7a20c"). InnerVolumeSpecName "kube-api-access-wlx7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:21:29.286940 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.286882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0089116b-25dc-411c-aa57-0364fe514324" (UID: "0089116b-25dc-411c-aa57-0364fe514324"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:21:29.385271 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.385249    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89btz\" (UniqueName: \"kubernetes.io/projected/0089116b-25dc-411c-aa57-0364fe514324-kube-api-access-89btz\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:29.385271 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.385272    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:29.385426 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.385282    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlx7q\" (UniqueName: \"kubernetes.io/projected/c4747367-6d2f-4704-a931-94b9dea7a20c-kube-api-access-wlx7q\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:29.385426 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.385291    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0089116b-25dc-411c-aa57-0364fe514324-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:21:29.432976 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.432949    2578 scope.go:117] "RemoveContainer" containerID="841be8f7775d687de2d942458b656b30864c209aeca460975128901e70f7d3a5"
Sep 09 16:21:29.441618 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.441599    2578 scope.go:117] "RemoveContainer" containerID="4dbcf2943ead2bd687801dd2af69442d89e8490d10596eceb39c1ee55377185c"
Sep 09 16:21:29.524367 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.524317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" event={"ID":"0089116b-25dc-411c-aa57-0364fe514324","Type":"ContainerDied","Data":"841be8f7775d687de2d942458b656b30864c209aeca460975128901e70f7d3a5"}
Sep 09 16:21:29.524471 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.524407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f" event={"ID":"0089116b-25dc-411c-aa57-0364fe514324","Type":"ContainerDied","Data":"709ac7b2f75ca9537d7e018015eda4da502db04cf0ec7df2f996b58c576b4479"}
Sep 09 16:21:29.524471 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.524429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"
Sep 09 16:21:29.524471 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.524437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt" event={"ID":"c4747367-6d2f-4704-a931-94b9dea7a20c","Type":"ContainerDied","Data":"4dbcf2943ead2bd687801dd2af69442d89e8490d10596eceb39c1ee55377185c"}
Sep 09 16:21:29.524471 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.524463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt" event={"ID":"c4747367-6d2f-4704-a931-94b9dea7a20c","Type":"ContainerDied","Data":"dd190119cfe04e8a6f1c06fa4a93e4a9dad434cb4bb76006685668cb3c0bbadc"}
Sep 09 16:21:29.524608 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.524429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"
Sep 09 16:21:29.567210 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.567185    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"]
Sep 09 16:21:29.570509 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.570489    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt"]
Sep 09 16:21:29.581205 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.581187    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"]
Sep 09 16:21:29.584621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:29.584603    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-008161-76cb96db8d-m442f"]
Sep 09 16:21:31.368491 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:31.368463    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0089116b-25dc-411c-aa57-0364fe514324" path="/var/lib/kubelet/pods/0089116b-25dc-411c-aa57-0364fe514324/volumes"
Sep 09 16:21:31.368872 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:31.368830    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4747367-6d2f-4704-a931-94b9dea7a20c" path="/var/lib/kubelet/pods/c4747367-6d2f-4704-a931-94b9dea7a20c/volumes"
Sep 09 16:21:53.230234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230200    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"]
Sep 09 16:21:53.230824 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230804    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0089116b-25dc-411c-aa57-0364fe514324" containerName="maas-api"
Sep 09 16:21:53.230870 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230827    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0089116b-25dc-411c-aa57-0364fe514324" containerName="maas-api"
Sep 09 16:21:53.230870 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230849    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy"
Sep 09 16:21:53.230870 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230858    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230874    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee62510-6b73-48ee-9831-3cdacd7e4cbb" containerName="maas-api"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230885    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee62510-6b73-48ee-9831-3cdacd7e4cbb" containerName="maas-api"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230894    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230903    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230913    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="441dee43-26d0-41ac-8630-87d55b25b933" containerName="maas-api"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230922    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="441dee43-26d0-41ac-8630-87d55b25b933" containerName="maas-api"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230932    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4747367-6d2f-4704-a931-94b9dea7a20c" containerName="payload-processing"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230941    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4747367-6d2f-4704-a931-94b9dea7a20c" containerName="payload-processing"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230950    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa083696-d564-4142-8ceb-ce77c5bc6841" containerName="maas-api"
Sep 09 16:21:53.230963 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.230959    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa083696-d564-4142-8ceb-ce77c5bc6841" containerName="maas-api"
Sep 09 16:21:53.231261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.231066    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4747367-6d2f-4704-a931-94b9dea7a20c" containerName="payload-processing"
Sep 09 16:21:53.231261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.231079    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0089116b-25dc-411c-aa57-0364fe514324" containerName="maas-api"
Sep 09 16:21:53.231261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.231088    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee62510-6b73-48ee-9831-3cdacd7e4cbb" containerName="maas-api"
Sep 09 16:21:53.231261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.231099    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa083696-d564-4142-8ceb-ce77c5bc6841" containerName="maas-api"
Sep 09 16:21:53.231261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.231109    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="441dee43-26d0-41ac-8630-87d55b25b933" containerName="maas-api"
Sep 09 16:21:53.231261 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.231120    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy"
Sep 09 16:21:53.235672 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.235655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.238462 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.238443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8cc2d6-openshift-default-dockercfg-hghk2\""
Sep 09 16:21:53.246042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.246015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"]
Sep 09 16:21:53.290393 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-socket\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290516 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-credential-socket\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290516 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc49201e-a967-4246-852b-29eee6180fe3-istiod-ca-cert\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290516 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6k9x\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-kube-api-access-f6k9x\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290685 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-envoy\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290685 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-istio-token\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290685 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc49201e-a967-4246-852b-29eee6180fe3-istio-podinfo\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290834 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-data\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.290834 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.290755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-certs\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-envoy\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392223 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-istio-token\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392223 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc49201e-a967-4246-852b-29eee6180fe3-istio-podinfo\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392333 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-data\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392333 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-certs\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392474 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-socket\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392474 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-credential-socket\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392575 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc49201e-a967-4246-852b-29eee6180fe3-istiod-ca-cert\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392575 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6k9x\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-kube-api-access-f6k9x\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-data\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-certs\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392860 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-socket\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.392916 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.392870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-credential-socket\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.393559 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.393535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc49201e-a967-4246-852b-29eee6180fe3-istiod-ca-cert\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.394838 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.394811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-envoy\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.395076 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.395044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc49201e-a967-4246-852b-29eee6180fe3-istio-podinfo\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.399858 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.399827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6k9x\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-kube-api-access-f6k9x\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.400360 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.400328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-istio-token\") pod \"e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") " pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.547308 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.547251    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:53.822924 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.822901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"]
Sep 09 16:21:53.824601 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:21:53.824574    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc49201e_a967_4246_852b_29eee6180fe3.slice/crio-38cd40482446ad1d5f2770644a33ba83380cdf069e42c3d6a6c0e8ecab2dae3a WatchSource:0}: Error finding container 38cd40482446ad1d5f2770644a33ba83380cdf069e42c3d6a6c0e8ecab2dae3a: Status 404 returned error can't find the container with id 38cd40482446ad1d5f2770644a33ba83380cdf069e42c3d6a6c0e8ecab2dae3a
Sep 09 16:21:53.827148 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.827112    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:21:53.827235 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.827182    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:21:53.827235 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:53.827211    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:21:54.665486 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:54.665451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" event={"ID":"fc49201e-a967-4246-852b-29eee6180fe3","Type":"ContainerStarted","Data":"77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"}
Sep 09 16:21:54.665956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:54.665517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" event={"ID":"fc49201e-a967-4246-852b-29eee6180fe3","Type":"ContainerStarted","Data":"38cd40482446ad1d5f2770644a33ba83380cdf069e42c3d6a6c0e8ecab2dae3a"}
Sep 09 16:21:54.687397 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:54.687328    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podStartSLOduration=1.687311449 podStartE2EDuration="1.687311449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:21:54.683963547 +0000 UTC m=+1825.945092723" watchObservedRunningTime="2026-09-09 16:21:54.687311449 +0000 UTC m=+1825.948440629"
Sep 09 16:21:55.548089 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:55.548062    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:55.553033 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:55.553012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:55.671212 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:55.671186    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:55.671973 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:55.671954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:21:57.846968 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.846938    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"]
Sep 09 16:21:57.847407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.847394    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f08bde-1dbd-4aae-bf92-02d1a9b554f6" containerName="istio-proxy"
Sep 09 16:21:57.850764 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.850745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:57.853527 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.853505    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-8cc2d6-serving-cert\""
Sep 09 16:21:57.862683 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.862642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"]
Sep 09 16:21:57.937967 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.937937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zqf8\" (UniqueName: \"kubernetes.io/projected/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-kube-api-access-7zqf8\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:57.938090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.937972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-metrics-certs\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:57.938090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.938020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:57.938090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:57.938042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.038557 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.038528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zqf8\" (UniqueName: \"kubernetes.io/projected/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-kube-api-access-7zqf8\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.038557 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.038560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-metrics-certs\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.038770 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.038591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.038770 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.038620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.038876 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:21:58.038817    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-serving-cert: secret "maas-api-e2e-ipp-a-8cc2d6-serving-cert" not found
Sep 09 16:21:58.038927 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:21:58.038915    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls podName:7130ba5c-3ec9-4eb3-83ac-137157edbfe1 nodeName:}" failed. No retries permitted until 2026-09-09 16:21:58.538893115 +0000 UTC m=+1829.800022286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls") pod "maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" (UID: "7130ba5c-3ec9-4eb3-83ac-137157edbfe1") : secret "maas-api-e2e-ipp-a-8cc2d6-serving-cert" not found
Sep 09 16:21:58.039226 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.039206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.041036 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.041013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-metrics-certs\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.058717 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.058687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zqf8\" (UniqueName: \"kubernetes.io/projected/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-kube-api-access-7zqf8\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.487225 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.487187    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"]
Sep 09 16:21:58.491838 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.491813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.495156 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.495132    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8cc2d6\""
Sep 09 16:21:58.495304 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.495165    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8cc2d6-dockercfg-h54cw\""
Sep 09 16:21:58.501885 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.501863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"]
Sep 09 16:21:58.544582 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.544556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwn4\" (UniqueName: \"kubernetes.io/projected/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-kube-api-access-ddwn4\") pod \"payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.544708 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.544622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.544783 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.544702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.546897 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.546880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.645730 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.645695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.645923 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.645787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwn4\" (UniqueName: \"kubernetes.io/projected/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-kube-api-access-ddwn4\") pod \"payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.646416 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.646396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.653835 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.653810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwn4\" (UniqueName: \"kubernetes.io/projected/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-kube-api-access-ddwn4\") pod \"payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:58.765822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.765759    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:21:58.803635 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:58.803400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:59.037717 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.037692    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"]
Sep 09 16:21:59.039444 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:21:59.039407    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7130ba5c_3ec9_4eb3_83ac_137157edbfe1.slice/crio-f8a55695638f64c56c1ae6e465a61e0d57ae308661098350fd7692da04a7cc8a WatchSource:0}: Error finding container f8a55695638f64c56c1ae6e465a61e0d57ae308661098350fd7692da04a7cc8a: Status 404 returned error can't find the container with id f8a55695638f64c56c1ae6e465a61e0d57ae308661098350fd7692da04a7cc8a
Sep 09 16:21:59.086519 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.086495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"]
Sep 09 16:21:59.088280 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:21:59.088246    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ec5d7c_21b7_4396_99dd_8a76e2c75eaf.slice/crio-7bc516ce69e18b3051d15d75f5c449eb55cdc2fed64dbf4c73aef6c50d53180e WatchSource:0}: Error finding container 7bc516ce69e18b3051d15d75f5c449eb55cdc2fed64dbf4c73aef6c50d53180e: Status 404 returned error can't find the container with id 7bc516ce69e18b3051d15d75f5c449eb55cdc2fed64dbf4c73aef6c50d53180e
Sep 09 16:21:59.696023 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.695981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" event={"ID":"7130ba5c-3ec9-4eb3-83ac-137157edbfe1","Type":"ContainerStarted","Data":"f8a55695638f64c56c1ae6e465a61e0d57ae308661098350fd7692da04a7cc8a"}
Sep 09 16:21:59.697862 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.697829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8" event={"ID":"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf","Type":"ContainerStarted","Data":"99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c"}
Sep 09 16:21:59.697989 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.697885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8" event={"ID":"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf","Type":"ContainerStarted","Data":"7bc516ce69e18b3051d15d75f5c449eb55cdc2fed64dbf4c73aef6c50d53180e"}
Sep 09 16:21:59.698063 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.698029    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:21:59.715165 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:21:59.715120    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8" podStartSLOduration=1.715101548 podStartE2EDuration="1.715101548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:21:59.713448155 +0000 UTC m=+1830.974577332" watchObservedRunningTime="2026-09-09 16:21:59.715101548 +0000 UTC m=+1830.976230725"
Sep 09 16:22:00.705105 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:00.705072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" event={"ID":"7130ba5c-3ec9-4eb3-83ac-137157edbfe1","Type":"ContainerStarted","Data":"16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672"}
Sep 09 16:22:00.724804 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:00.724753    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" podStartSLOduration=3.065125631 podStartE2EDuration="3.72473749s" totalImagesPullingTime="659.611859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:22:00.721798537 +0000 UTC m=+1831.982927703" watchObservedRunningTime="2026-09-09 16:22:00.72473749 +0000 UTC m=+1831.985866666"
Sep 09 16:22:01.710263 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:01.710234    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:22:07.721871 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:07.721836    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:22:10.707572 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:10.707536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:22:11.483809 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.483046    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": read tcp 10.133.0.2:42566->10.133.0.75:15021: read: connection reset by peer" start-of-body=
Sep 09 16:22:11.483809 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.483116    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": read tcp 10.133.0.2:42566->10.133.0.75:15021: read: connection reset by peer"
Sep 09 16:22:11.768859 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.768777    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc49201e-a967-4246-852b-29eee6180fe3" containerID="77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623" exitCode=0
Sep 09 16:22:11.768859 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.768846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" event={"ID":"fc49201e-a967-4246-852b-29eee6180fe3","Type":"ContainerDied","Data":"77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"}
Sep 09 16:22:11.769278 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.769262    2578 scope.go:117] "RemoveContainer" containerID="77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"
Sep 09 16:22:11.770374 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.770324    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:22:11.770437 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.770417    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:22:11.770479 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:11.770454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:22:12.778828 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:12.778781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" event={"ID":"fc49201e-a967-4246-852b-29eee6180fe3","Type":"ContainerStarted","Data":"655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50"}
Sep 09 16:22:13.547736 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:13.547698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:22:13.547958 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:13.547932    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 09 16:22:13.548040 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:13.547994    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 09 16:22:14.548313 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:14.548270    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 09 16:22:14.548822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:14.548344    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 09 16:22:15.547929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:15.547893    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 09 16:22:15.548102 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:15.547945    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 09 16:22:16.547786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:16.547748    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 09 16:22:16.548173 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:16.547805    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 09 16:22:17.548143 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:17.548108    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 09 16:22:17.548625 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:17.548166    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 09 16:22:18.552067 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:18.552034    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:22:18.552567 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:18.552316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:22:18.553029 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:18.553012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:22:55.964490 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:22:55.964405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pw6qh_816139fc-4aa6-4afe-9ad4-37008de3b432/payload-processing/0.log"
Sep 09 16:23:36.779585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:36.779548    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8_c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf/payload-processing/0.log"
Sep 09 16:23:36.907615 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:36.907580    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pw6qh_816139fc-4aa6-4afe-9ad4-37008de3b432/payload-processing/0.log"
Sep 09 16:23:37.577555 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.577521    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"]
Sep 09 16:23:37.581263 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.581237    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.584084 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.584057    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-6ddd57-openshift-default-dockercfg-vgmvs\""
Sep 09 16:23:37.592547 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.592416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"]
Sep 09 16:23:37.730153 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07419953-e253-4bee-9f76-b07ec61ee9e7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730153 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-envoy\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-certs\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-socket\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-data\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-podinfo\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdsn\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-kube-api-access-5rdsn\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-token\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.730625 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.730461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-credential-socket\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.831551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-certs\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.831551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-socket\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.831551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-data\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-podinfo\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdsn\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-kube-api-access-5rdsn\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-token\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-credential-socket\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07419953-e253-4bee-9f76-b07ec61ee9e7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-certs\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-envoy\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832098 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.831968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-data\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.832191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-credential-socket\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832436 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.832203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-socket\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.832607 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.832589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07419953-e253-4bee-9f76-b07ec61ee9e7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.833982 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.833961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-envoy\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.834226 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.834206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-podinfo\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.839919 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.839891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-token\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.840065 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.840017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdsn\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-kube-api-access-5rdsn\") pod \"e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") " pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:37.894688 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:37.894647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:38.178901 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.178866    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"]
Sep 09 16:23:38.179457 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:23:38.179431    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07419953_e253_4bee_9f76_b07ec61ee9e7.slice/crio-deb03375c35e3654fc79c98b362649086a83dcbb0e52ea4952e0f47628e534b7 WatchSource:0}: Error finding container deb03375c35e3654fc79c98b362649086a83dcbb0e52ea4952e0f47628e534b7: Status 404 returned error can't find the container with id deb03375c35e3654fc79c98b362649086a83dcbb0e52ea4952e0f47628e534b7
Sep 09 16:23:38.182110 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.182071    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:23:38.182224 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.182141    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:23:38.182224 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.182174    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:23:38.288236 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.288198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" event={"ID":"07419953-e253-4bee-9f76-b07ec61ee9e7","Type":"ContainerStarted","Data":"09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"}
Sep 09 16:23:38.288468 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.288259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" event={"ID":"07419953-e253-4bee-9f76-b07ec61ee9e7","Type":"ContainerStarted","Data":"deb03375c35e3654fc79c98b362649086a83dcbb0e52ea4952e0f47628e534b7"}
Sep 09 16:23:38.310433 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.310379    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podStartSLOduration=1.310343662 podStartE2EDuration="1.310343662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:23:38.30713496 +0000 UTC m=+1929.568264140" watchObservedRunningTime="2026-09-09 16:23:38.310343662 +0000 UTC m=+1929.571472835"
Sep 09 16:23:38.895805 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:38.895771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:39.900737 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:39.900705    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:40.300773 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:40.300741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:40.301834 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:40.301812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:23:42.063133 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.063095    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"]
Sep 09 16:23:42.067060 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.067040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.069819 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.069793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-6ddd57-dockercfg-xszgw\""
Sep 09 16:23:42.069956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.069935    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-6ddd57\""
Sep 09 16:23:42.079886 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.079851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"]
Sep 09 16:23:42.180258 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.180219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jk6z\" (UniqueName: \"kubernetes.io/projected/21e8270e-f297-425b-9e80-4b9f4921ce4b-kube-api-access-9jk6z\") pod \"payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.180527 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.180497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21e8270e-f297-425b-9e80-4b9f4921ce4b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.281736 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.281697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21e8270e-f297-425b-9e80-4b9f4921ce4b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.281936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.281840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jk6z\" (UniqueName: \"kubernetes.io/projected/21e8270e-f297-425b-9e80-4b9f4921ce4b-kube-api-access-9jk6z\") pod \"payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.282532 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.282504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21e8270e-f297-425b-9e80-4b9f4921ce4b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.290000 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.289977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jk6z\" (UniqueName: \"kubernetes.io/projected/21e8270e-f297-425b-9e80-4b9f4921ce4b-kube-api-access-9jk6z\") pod \"payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.381570 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.381474    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:42.655283 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:42.655253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"]
Sep 09 16:23:42.656167 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:23:42.656142    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e8270e_f297_425b_9e80_4b9f4921ce4b.slice/crio-6f27379269ddd00cea904d0182f563dc6e68c676334ff5e86f498086b9c2f472 WatchSource:0}: Error finding container 6f27379269ddd00cea904d0182f563dc6e68c676334ff5e86f498086b9c2f472: Status 404 returned error can't find the container with id 6f27379269ddd00cea904d0182f563dc6e68c676334ff5e86f498086b9c2f472
Sep 09 16:23:43.320156 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:43.320118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg" event={"ID":"21e8270e-f297-425b-9e80-4b9f4921ce4b","Type":"ContainerStarted","Data":"b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a"}
Sep 09 16:23:43.320633 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:43.320192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:23:43.320633 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:43.320214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg" event={"ID":"21e8270e-f297-425b-9e80-4b9f4921ce4b","Type":"ContainerStarted","Data":"6f27379269ddd00cea904d0182f563dc6e68c676334ff5e86f498086b9c2f472"}
Sep 09 16:23:43.338443 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:43.338394    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg" podStartSLOduration=1.338377058 podStartE2EDuration="1.338377058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:23:43.335626534 +0000 UTC m=+1934.596755712" watchObservedRunningTime="2026-09-09 16:23:43.338377058 +0000 UTC m=+1934.599506231"
Sep 09 16:23:54.329382 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:23:54.329325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:24:01.445166 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:01.445134    2578 generic.go:356] "Generic (PLEG): container finished" podID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerID="09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43" exitCode=0
Sep 09 16:24:01.445588 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:01.445207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" event={"ID":"07419953-e253-4bee-9f76-b07ec61ee9e7","Type":"ContainerDied","Data":"09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"}
Sep 09 16:24:01.445646 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:01.445592    2578 scope.go:117] "RemoveContainer" containerID="09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"
Sep 09 16:24:01.446884 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:01.446856    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:24:01.446949 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:01.446922    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:24:01.446986 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:01.446956    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 16:24:02.452931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:02.452899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" event={"ID":"07419953-e253-4bee-9f76-b07ec61ee9e7","Type":"ContainerStarted","Data":"f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53"}
Sep 09 16:24:02.895331 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:02.895224    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:24:02.896414 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:02.896385    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:24:02.896622 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:02.896597    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 09 16:24:03.895898 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:03.895855    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:24:03.896474 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:03.896438    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 09 16:24:04.895451 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:04.895414    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:24:04.895767 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:04.895736    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 09 16:24:05.896402 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:05.895977    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:24:05.896402 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:05.896055    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 09 16:24:06.895620 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:06.895571    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:24:06.895870 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:06.895644    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 09 16:24:07.896390 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:07.895975    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:24:07.896390 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:07.896040    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 09 16:24:08.899205 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:08.899179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:24:08.899605 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:08.899588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:24:08.900193 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:08.900170    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:24:12.047632 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.047598    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"]
Sep 09 16:24:12.048126 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.047804    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg" podUID="21e8270e-f297-425b-9e80-4b9f4921ce4b" containerName="payload-processing" containerID="cri-o://b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a" gracePeriod=30
Sep 09 16:24:12.299474 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.299410    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:24:12.385679 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.385645    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jk6z\" (UniqueName: \"kubernetes.io/projected/21e8270e-f297-425b-9e80-4b9f4921ce4b-kube-api-access-9jk6z\") pod \"21e8270e-f297-425b-9e80-4b9f4921ce4b\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") "
Sep 09 16:24:12.385850 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.385694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21e8270e-f297-425b-9e80-4b9f4921ce4b-plugins-config-volume\") pod \"21e8270e-f297-425b-9e80-4b9f4921ce4b\" (UID: \"21e8270e-f297-425b-9e80-4b9f4921ce4b\") "
Sep 09 16:24:12.386121 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.386086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e8270e-f297-425b-9e80-4b9f4921ce4b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21e8270e-f297-425b-9e80-4b9f4921ce4b" (UID: "21e8270e-f297-425b-9e80-4b9f4921ce4b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:24:12.387726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.387704    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e8270e-f297-425b-9e80-4b9f4921ce4b-kube-api-access-9jk6z" (OuterVolumeSpecName: "kube-api-access-9jk6z") pod "21e8270e-f297-425b-9e80-4b9f4921ce4b" (UID: "21e8270e-f297-425b-9e80-4b9f4921ce4b"). InnerVolumeSpecName "kube-api-access-9jk6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:12.487111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.487083    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jk6z\" (UniqueName: \"kubernetes.io/projected/21e8270e-f297-425b-9e80-4b9f4921ce4b-kube-api-access-9jk6z\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:12.487111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.487106    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21e8270e-f297-425b-9e80-4b9f4921ce4b-plugins-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:12.520448 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.520407    2578 generic.go:356] "Generic (PLEG): container finished" podID="21e8270e-f297-425b-9e80-4b9f4921ce4b" containerID="b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a" exitCode=0
Sep 09 16:24:12.520586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.520453    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"
Sep 09 16:24:12.520586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.520459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg" event={"ID":"21e8270e-f297-425b-9e80-4b9f4921ce4b","Type":"ContainerDied","Data":"b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a"}
Sep 09 16:24:12.520586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.520574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg" event={"ID":"21e8270e-f297-425b-9e80-4b9f4921ce4b","Type":"ContainerDied","Data":"6f27379269ddd00cea904d0182f563dc6e68c676334ff5e86f498086b9c2f472"}
Sep 09 16:24:12.520757 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.520604    2578 scope.go:117] "RemoveContainer" containerID="b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a"
Sep 09 16:24:12.530607 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.530591    2578 scope.go:117] "RemoveContainer" containerID="b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a"
Sep 09 16:24:12.530878 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:24:12.530861    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a\": container with ID starting with b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a not found: ID does not exist" containerID="b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a"
Sep 09 16:24:12.530936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.530886    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a"} err="failed to get container status \"b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a\": rpc error: code = NotFound desc = could not find container \"b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a\": container with ID starting with b9713f6f07fbf87122968c9179340f128baf85f4feecaad9d76a7a28bb88aa1a not found: ID does not exist"
Sep 09 16:24:12.541553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.541533    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"]
Sep 09 16:24:12.558592 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:12.558542    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg"]
Sep 09 16:24:13.368651 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:13.368621    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e8270e-f297-425b-9e80-4b9f4921ce4b" path="/var/lib/kubelet/pods/21e8270e-f297-425b-9e80-4b9f4921ce4b/volumes"
Sep 09 16:24:18.560849 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:18.560821    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"]
Sep 09 16:24:18.561319 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:18.561031    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy" containerID="cri-o://f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53" gracePeriod=30
Sep 09 16:24:23.817242 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.817218    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:24:23.888889 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.888822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-data\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.888888    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-podinfo\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.888918    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07419953-e253-4bee-9f76-b07ec61ee9e7-istiod-ca-cert\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.888944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-socket\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.888985    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-credential-socket\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889017    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-envoy\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889073    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-token\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:23.889196 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rdsn\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-kube-api-access-5rdsn\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.889426 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889337    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07419953-e253-4bee-9f76-b07ec61ee9e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:24:23.889426 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:23.889596 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889575    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.889660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889601    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07419953-e253-4bee-9f76-b07ec61ee9e7-istiod-ca-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.889660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889615    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.889660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.889640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:23.891046 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.891023    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:24:23.891162 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.891144    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:23.891279 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.891264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-kube-api-access-5rdsn" (OuterVolumeSpecName: "kube-api-access-5rdsn") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "kube-api-access-5rdsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:23.891321 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.891290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:23.990429 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990403    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-certs\") pod \"07419953-e253-4bee-9f76-b07ec61ee9e7\" (UID: \"07419953-e253-4bee-9f76-b07ec61ee9e7\") "
Sep 09 16:24:23.990610 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990599    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-podinfo\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.990660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990613    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-credential-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.990660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990622    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-envoy\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.990660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990630    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-istio-token\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:23.990660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07419953-e253-4bee-9f76-b07ec61ee9e7" (UID: "07419953-e253-4bee-9f76-b07ec61ee9e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:23.990660 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:23.990638    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rdsn\" (UniqueName: \"kubernetes.io/projected/07419953-e253-4bee-9f76-b07ec61ee9e7-kube-api-access-5rdsn\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:24.092076 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.092053    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07419953-e253-4bee-9f76-b07ec61ee9e7-workload-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:24.599313 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.599278    2578 generic.go:356] "Generic (PLEG): container finished" podID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerID="f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53" exitCode=0
Sep 09 16:24:24.599533 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.599318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" event={"ID":"07419953-e253-4bee-9f76-b07ec61ee9e7","Type":"ContainerDied","Data":"f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53"}
Sep 09 16:24:24.599533 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.599336    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"
Sep 09 16:24:24.599533 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.599400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v" event={"ID":"07419953-e253-4bee-9f76-b07ec61ee9e7","Type":"ContainerDied","Data":"deb03375c35e3654fc79c98b362649086a83dcbb0e52ea4952e0f47628e534b7"}
Sep 09 16:24:24.599533 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.599434    2578 scope.go:117] "RemoveContainer" containerID="f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53"
Sep 09 16:24:24.610828 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.610804    2578 scope.go:117] "RemoveContainer" containerID="09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"
Sep 09 16:24:24.619623 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.619441    2578 scope.go:117] "RemoveContainer" containerID="f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53"
Sep 09 16:24:24.619908 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:24:24.619881    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53\": container with ID starting with f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53 not found: ID does not exist" containerID="f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53"
Sep 09 16:24:24.620016 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.619917    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53"} err="failed to get container status \"f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53\": rpc error: code = NotFound desc = could not find container \"f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53\": container with ID starting with f6f5dc840a3e3c313b0a2947b83623ab85a61d9d5a0528a4a16468b139843f53 not found: ID does not exist"
Sep 09 16:24:24.620016 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.619935    2578 scope.go:117] "RemoveContainer" containerID="09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"
Sep 09 16:24:24.620213 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:24:24.620195    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43\": container with ID starting with 09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43 not found: ID does not exist" containerID="09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"
Sep 09 16:24:24.620284 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.620216    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43"} err="failed to get container status \"09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43\": rpc error: code = NotFound desc = could not find container \"09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43\": container with ID starting with 09cf4144afd9f2812b27bd0dd5af165735118c66ddf28fef6059c49c489e1d43 not found: ID does not exist"
Sep 09 16:24:24.622512 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.622493    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"]
Sep 09 16:24:24.626004 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:24.625982    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v"]
Sep 09 16:24:25.368877 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:25.368850    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" path="/var/lib/kubelet/pods/07419953-e253-4bee-9f76-b07ec61ee9e7/volumes"
Sep 09 16:24:37.925325 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:37.925293    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"]
Sep 09 16:24:37.925750 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:37.925520    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" podUID="7130ba5c-3ec9-4eb3-83ac-137157edbfe1" containerName="maas-api" containerID="cri-o://16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672" gracePeriod=30
Sep 09 16:24:37.971014 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:37.970984    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"]
Sep 09 16:24:37.971234 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:37.971185    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8" podUID="c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" containerName="payload-processing" containerID="cri-o://99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c" gracePeriod=30
Sep 09 16:24:38.224272 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.224245    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:24:38.261783 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.261754    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:24:38.328515 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.328488    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zqf8\" (UniqueName: \"kubernetes.io/projected/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-kube-api-access-7zqf8\") pod \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") "
Sep 09 16:24:38.328637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.328572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-metrics-certs\") pod \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") "
Sep 09 16:24:38.328637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.328598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls\") pod \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") "
Sep 09 16:24:38.328637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.328620    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddwn4\" (UniqueName: \"kubernetes.io/projected/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-kube-api-access-ddwn4\") pod \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") "
Sep 09 16:24:38.328814 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.328656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-plugins-config-volume\") pod \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\" (UID: \"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf\") "
Sep 09 16:24:38.328814 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.328702    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-openshift-service-ca\") pod \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\" (UID: \"7130ba5c-3ec9-4eb3-83ac-137157edbfe1\") "
Sep 09 16:24:38.329069 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.329041    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" (UID: "c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:24:38.329183 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.329066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7130ba5c-3ec9-4eb3-83ac-137157edbfe1" (UID: "7130ba5c-3ec9-4eb3-83ac-137157edbfe1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:24:38.330739 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.330710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7130ba5c-3ec9-4eb3-83ac-137157edbfe1" (UID: "7130ba5c-3ec9-4eb3-83ac-137157edbfe1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:24:38.330739 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.330726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-kube-api-access-ddwn4" (OuterVolumeSpecName: "kube-api-access-ddwn4") pod "c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" (UID: "c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf"). InnerVolumeSpecName "kube-api-access-ddwn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:38.331042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.331024    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-kube-api-access-7zqf8" (OuterVolumeSpecName: "kube-api-access-7zqf8") pod "7130ba5c-3ec9-4eb3-83ac-137157edbfe1" (UID: "7130ba5c-3ec9-4eb3-83ac-137157edbfe1"). InnerVolumeSpecName "kube-api-access-7zqf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:38.331085 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.331027    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7130ba5c-3ec9-4eb3-83ac-137157edbfe1" (UID: "7130ba5c-3ec9-4eb3-83ac-137157edbfe1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:24:38.430299 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.430267    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-plugins-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:38.430299 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.430299    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:38.430492 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.430314    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zqf8\" (UniqueName: \"kubernetes.io/projected/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-kube-api-access-7zqf8\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:38.430492 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.430328    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:38.430492 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.430341    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7130ba5c-3ec9-4eb3-83ac-137157edbfe1-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:38.430492 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.430380    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddwn4\" (UniqueName: \"kubernetes.io/projected/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf-kube-api-access-ddwn4\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:24:38.679283 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.679246    2578 generic.go:356] "Generic (PLEG): container finished" podID="c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" containerID="99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c" exitCode=0
Sep 09 16:24:38.679585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.679332    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"
Sep 09 16:24:38.679585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.679340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8" event={"ID":"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf","Type":"ContainerDied","Data":"99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c"}
Sep 09 16:24:38.679585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.679425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8" event={"ID":"c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf","Type":"ContainerDied","Data":"7bc516ce69e18b3051d15d75f5c449eb55cdc2fed64dbf4c73aef6c50d53180e"}
Sep 09 16:24:38.679585 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.679451    2578 scope.go:117] "RemoveContainer" containerID="99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c"
Sep 09 16:24:38.680910 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.680889    2578 generic.go:356] "Generic (PLEG): container finished" podID="7130ba5c-3ec9-4eb3-83ac-137157edbfe1" containerID="16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672" exitCode=0
Sep 09 16:24:38.681013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.680945    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"
Sep 09 16:24:38.681013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.680980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" event={"ID":"7130ba5c-3ec9-4eb3-83ac-137157edbfe1","Type":"ContainerDied","Data":"16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672"}
Sep 09 16:24:38.681101 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.681028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x" event={"ID":"7130ba5c-3ec9-4eb3-83ac-137157edbfe1","Type":"ContainerDied","Data":"f8a55695638f64c56c1ae6e465a61e0d57ae308661098350fd7692da04a7cc8a"}
Sep 09 16:24:38.689341 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.689325    2578 scope.go:117] "RemoveContainer" containerID="99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c"
Sep 09 16:24:38.689659 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:24:38.689640    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c\": container with ID starting with 99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c not found: ID does not exist" containerID="99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c"
Sep 09 16:24:38.689724 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.689666    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c"} err="failed to get container status \"99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c\": rpc error: code = NotFound desc = could not find container \"99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c\": container with ID starting with 99d4a1589b051dd22eff3fe9faeb35aef4a5cafd29383e8d0dd81654193fa99c not found: ID does not exist"
Sep 09 16:24:38.689724 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.689684    2578 scope.go:117] "RemoveContainer" containerID="16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672"
Sep 09 16:24:38.697996 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.697979    2578 scope.go:117] "RemoveContainer" containerID="16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672"
Sep 09 16:24:38.698234 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:24:38.698218    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672\": container with ID starting with 16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672 not found: ID does not exist" containerID="16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672"
Sep 09 16:24:38.698279 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.698240    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672"} err="failed to get container status \"16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672\": rpc error: code = NotFound desc = could not find container \"16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672\": container with ID starting with 16455daa0a24827fcfc55593f80f5bddbcc632479b6f1be14ed831a0f2541672 not found: ID does not exist"
Sep 09 16:24:38.726994 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.726973    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"]
Sep 09 16:24:38.735025 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.735005    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8cc2d6-7c89b5c58f-fwr7x"]
Sep 09 16:24:38.765671 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.765644    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"]
Sep 09 16:24:38.770244 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:38.770225    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8"]
Sep 09 16:24:39.368863 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:39.368837    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7130ba5c-3ec9-4eb3-83ac-137157edbfe1" path="/var/lib/kubelet/pods/7130ba5c-3ec9-4eb3-83ac-137157edbfe1/volumes"
Sep 09 16:24:39.369218 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:24:39.369174    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" path="/var/lib/kubelet/pods/c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf/volumes"
Sep 09 16:25:26.385093 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:26.385060    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"]
Sep 09 16:25:26.385701 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:26.385258    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy" containerID="cri-o://655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50" gracePeriod=30
Sep 09 16:25:31.642430 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.642407    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:25:31.754917 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.754892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-data\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.754927    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-credential-socket\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.754963    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-socket\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.754997    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-envoy\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-certs\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755047    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc49201e-a967-4246-852b-29eee6180fe3-istio-podinfo\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc49201e-a967-4246-852b-29eee6180fe3-istiod-ca-cert\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755470 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755131    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-istio-token\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755470 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6k9x\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-kube-api-access-f6k9x\") pod \"fc49201e-a967-4246-852b-29eee6180fe3\" (UID: \"fc49201e-a967-4246-852b-29eee6180fe3\") "
Sep 09 16:25:31.755470 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755210    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:25:31.755470 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755226    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:25:31.755470 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:25:31.755735 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755566    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:25:31.755735 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755590    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.755735 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755598    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc49201e-a967-4246-852b-29eee6180fe3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:25:31.755735 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755613    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-credential-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.755735 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.755660    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-socket\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.757387 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.757333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc49201e-a967-4246-852b-29eee6180fe3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:25:31.757501 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.757406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:25:31.757501 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.757435    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:25:31.757582 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.757513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-kube-api-access-f6k9x" (OuterVolumeSpecName: "kube-api-access-f6k9x") pod "fc49201e-a967-4246-852b-29eee6180fe3" (UID: "fc49201e-a967-4246-852b-29eee6180fe3"). InnerVolumeSpecName "kube-api-access-f6k9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:25:31.856325 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.856301    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-istio-envoy\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.856325 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.856322    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc49201e-a967-4246-852b-29eee6180fe3-workload-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.856489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.856331    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc49201e-a967-4246-852b-29eee6180fe3-istio-podinfo\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.856489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.856340    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc49201e-a967-4246-852b-29eee6180fe3-istiod-ca-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.856489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.856368    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-istio-token\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:31.856489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:31.856382    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6k9x\" (UniqueName: \"kubernetes.io/projected/fc49201e-a967-4246-852b-29eee6180fe3-kube-api-access-f6k9x\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:32.017025 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.016954    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc49201e-a967-4246-852b-29eee6180fe3" containerID="655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50" exitCode=0
Sep 09 16:25:32.017025 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.017003    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"
Sep 09 16:25:32.017190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.017034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" event={"ID":"fc49201e-a967-4246-852b-29eee6180fe3","Type":"ContainerDied","Data":"655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50"}
Sep 09 16:25:32.017190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.017086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg" event={"ID":"fc49201e-a967-4246-852b-29eee6180fe3","Type":"ContainerDied","Data":"38cd40482446ad1d5f2770644a33ba83380cdf069e42c3d6a6c0e8ecab2dae3a"}
Sep 09 16:25:32.017190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.017110    2578 scope.go:117] "RemoveContainer" containerID="655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50"
Sep 09 16:25:32.027110 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.027096    2578 scope.go:117] "RemoveContainer" containerID="77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"
Sep 09 16:25:32.035146 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.035130    2578 scope.go:117] "RemoveContainer" containerID="655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50"
Sep 09 16:25:32.035430 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:25:32.035409    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50\": container with ID starting with 655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50 not found: ID does not exist" containerID="655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50"
Sep 09 16:25:32.035489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.035438    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50"} err="failed to get container status \"655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50\": rpc error: code = NotFound desc = could not find container \"655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50\": container with ID starting with 655e00dfa0cf3d8e261da9add49a9590bd4df4285e5d626641278997c1eadc50 not found: ID does not exist"
Sep 09 16:25:32.035489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.035454    2578 scope.go:117] "RemoveContainer" containerID="77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"
Sep 09 16:25:32.035693 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:25:32.035676    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623\": container with ID starting with 77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623 not found: ID does not exist" containerID="77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"
Sep 09 16:25:32.035737 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.035701    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623"} err="failed to get container status \"77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623\": rpc error: code = NotFound desc = could not find container \"77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623\": container with ID starting with 77f2ed37522ee44c6e8e70fcb3baacc729188ba448a4f0dd029d127344863623 not found: ID does not exist"
Sep 09 16:25:32.040529 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.040511    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"]
Sep 09 16:25:32.044380 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:32.044358    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg"]
Sep 09 16:25:33.367899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:33.367866    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc49201e-a967-4246-852b-29eee6180fe3" path="/var/lib/kubelet/pods/fc49201e-a967-4246-852b-29eee6180fe3/volumes"
Sep 09 16:25:54.787957 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:54.787771    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"]
Sep 09 16:25:54.788726 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:54.788666    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn" podUID="ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" containerName="maas-api" containerID="cri-o://e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51" gracePeriod=30
Sep 09 16:25:55.032244 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.032218    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:25:55.150020 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.149941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-openshift-service-ca\") pod \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") "
Sep 09 16:25:55.150020 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.149982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-metrics-certs\") pod \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") "
Sep 09 16:25:55.150246 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.150029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-maas-api-tls\") pod \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") "
Sep 09 16:25:55.150246 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.150062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj5pz\" (UniqueName: \"kubernetes.io/projected/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-kube-api-access-xj5pz\") pod \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\" (UID: \"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f\") "
Sep 09 16:25:55.150407 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.150377    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" (UID: "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:25:55.151883 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.151850    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" containerID="e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51" exitCode=0
Sep 09 16:25:55.152013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.151899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn" event={"ID":"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f","Type":"ContainerDied","Data":"e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51"}
Sep 09 16:25:55.152013 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.151920    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"
Sep 09 16:25:55.152145 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.152014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn" event={"ID":"ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f","Type":"ContainerDied","Data":"ccbd3bdc58cba03ad143f001d7a4b55554470a12e59b794ee7f6c91236b48ef8"}
Sep 09 16:25:55.152145 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.152051    2578 scope.go:117] "RemoveContainer" containerID="e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51"
Sep 09 16:25:55.152555 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.152523    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" (UID: "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:25:55.152659 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.152636    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-kube-api-access-xj5pz" (OuterVolumeSpecName: "kube-api-access-xj5pz") pod "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" (UID: "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f"). InnerVolumeSpecName "kube-api-access-xj5pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:25:55.152945 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.152912    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" (UID: "ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:25:55.171268 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.171247    2578 scope.go:117] "RemoveContainer" containerID="e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51"
Sep 09 16:25:55.171563 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:25:55.171541    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51\": container with ID starting with e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51 not found: ID does not exist" containerID="e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51"
Sep 09 16:25:55.171631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.171571    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51"} err="failed to get container status \"e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51\": rpc error: code = NotFound desc = could not find container \"e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51\": container with ID starting with e4b3de630b2fa695f193c1b109264d6e73ea960e34affbad570a9194bc195f51 not found: ID does not exist"
Sep 09 16:25:55.251581 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.251547    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:55.251581 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.251574    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:55.251581 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.251583    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:55.251799 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.251591    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj5pz\" (UniqueName: \"kubernetes.io/projected/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f-kube-api-access-xj5pz\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:25:55.468734 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.468705    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"]
Sep 09 16:25:55.472671 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:55.472649    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-131689-668b8887cd-bhgdn"]
Sep 09 16:25:57.368537 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:25:57.368503    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" path="/var/lib/kubelet/pods/ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f/volumes"
Sep 09 16:26:12.127509 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.127474    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"]
Sep 09 16:26:12.128037 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.127754    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q" podUID="23bc2ed4-52e8-4158-b6f7-9e358fde5832" containerName="maas-api" containerID="cri-o://f8520d443216754d992375a7cd0f57be82f1578536ac997b2138eb0851e40d43" gracePeriod=30
Sep 09 16:26:12.254719 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.254686    2578 generic.go:356] "Generic (PLEG): container finished" podID="23bc2ed4-52e8-4158-b6f7-9e358fde5832" containerID="f8520d443216754d992375a7cd0f57be82f1578536ac997b2138eb0851e40d43" exitCode=0
Sep 09 16:26:12.254866 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.254764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q" event={"ID":"23bc2ed4-52e8-4158-b6f7-9e358fde5832","Type":"ContainerDied","Data":"f8520d443216754d992375a7cd0f57be82f1578536ac997b2138eb0851e40d43"}
Sep 09 16:26:12.369814 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.369789    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:26:12.514219 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.514184    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc2ed4-52e8-4158-b6f7-9e358fde5832-openshift-service-ca\") pod \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") "
Sep 09 16:26:12.514425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.514227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfhqj\" (UniqueName: \"kubernetes.io/projected/23bc2ed4-52e8-4158-b6f7-9e358fde5832-kube-api-access-qfhqj\") pod \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") "
Sep 09 16:26:12.514425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.514303    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-maas-api-tls\") pod \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") "
Sep 09 16:26:12.514425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.514334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-metrics-certs\") pod \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\" (UID: \"23bc2ed4-52e8-4158-b6f7-9e358fde5832\") "
Sep 09 16:26:12.514619 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.514576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23bc2ed4-52e8-4158-b6f7-9e358fde5832-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23bc2ed4-52e8-4158-b6f7-9e358fde5832" (UID: "23bc2ed4-52e8-4158-b6f7-9e358fde5832"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:26:12.514705 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.514688    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc2ed4-52e8-4158-b6f7-9e358fde5832-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:12.516418 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.516388    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23bc2ed4-52e8-4158-b6f7-9e358fde5832" (UID: "23bc2ed4-52e8-4158-b6f7-9e358fde5832"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:26:12.516533 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.516456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23bc2ed4-52e8-4158-b6f7-9e358fde5832" (UID: "23bc2ed4-52e8-4158-b6f7-9e358fde5832"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:26:12.516533 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.516526    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23bc2ed4-52e8-4158-b6f7-9e358fde5832-kube-api-access-qfhqj" (OuterVolumeSpecName: "kube-api-access-qfhqj") pod "23bc2ed4-52e8-4158-b6f7-9e358fde5832" (UID: "23bc2ed4-52e8-4158-b6f7-9e358fde5832"). InnerVolumeSpecName "kube-api-access-qfhqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:26:12.616011 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.615974    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfhqj\" (UniqueName: \"kubernetes.io/projected/23bc2ed4-52e8-4158-b6f7-9e358fde5832-kube-api-access-qfhqj\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:12.616182 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.616026    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:12.616182 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:12.616036    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23bc2ed4-52e8-4158-b6f7-9e358fde5832-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:13.261710 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:13.261677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q" event={"ID":"23bc2ed4-52e8-4158-b6f7-9e358fde5832","Type":"ContainerDied","Data":"bb13761bd3182056fa23f03b2bca141bc52fda0824a8b5a882532d296a3fd81e"}
Sep 09 16:26:13.261710 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:13.261698    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"
Sep 09 16:26:13.262190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:13.261738    2578 scope.go:117] "RemoveContainer" containerID="f8520d443216754d992375a7cd0f57be82f1578536ac997b2138eb0851e40d43"
Sep 09 16:26:13.283511 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:13.283487    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"]
Sep 09 16:26:13.288715 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:13.288685    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13d59f-7f8d86bfbf-9dp5q"]
Sep 09 16:26:13.367697 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:13.367670    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23bc2ed4-52e8-4158-b6f7-9e358fde5832" path="/var/lib/kubelet/pods/23bc2ed4-52e8-4158-b6f7-9e358fde5832/volumes"
Sep 09 16:26:21.286532 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.286491    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-stqcb"]
Sep 09 16:26:21.286971 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.286727    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b4d875bf9-stqcb" podUID="710c0d01-c0d0-45c7-be17-59d3befbfc03" containerName="manager" containerID="cri-o://3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916" gracePeriod=30
Sep 09 16:26:21.536042 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.536022    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:26:21.584541 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.584475    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert\") pod \"710c0d01-c0d0-45c7-be17-59d3befbfc03\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") "
Sep 09 16:26:21.584541 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.584534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-metrics-certs\") pod \"710c0d01-c0d0-45c7-be17-59d3befbfc03\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") "
Sep 09 16:26:21.584740 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.584613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dp8b\" (UniqueName: \"kubernetes.io/projected/710c0d01-c0d0-45c7-be17-59d3befbfc03-kube-api-access-6dp8b\") pod \"710c0d01-c0d0-45c7-be17-59d3befbfc03\" (UID: \"710c0d01-c0d0-45c7-be17-59d3befbfc03\") "
Sep 09 16:26:21.586714 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.586686    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "710c0d01-c0d0-45c7-be17-59d3befbfc03" (UID: "710c0d01-c0d0-45c7-be17-59d3befbfc03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:26:21.586806 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.586708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710c0d01-c0d0-45c7-be17-59d3befbfc03-kube-api-access-6dp8b" (OuterVolumeSpecName: "kube-api-access-6dp8b") pod "710c0d01-c0d0-45c7-be17-59d3befbfc03" (UID: "710c0d01-c0d0-45c7-be17-59d3befbfc03"). InnerVolumeSpecName "kube-api-access-6dp8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:26:21.586985 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.586967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "710c0d01-c0d0-45c7-be17-59d3befbfc03" (UID: "710c0d01-c0d0-45c7-be17-59d3befbfc03"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:26:21.685974 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.685948    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-webhook-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:21.685974 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.685974    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/710c0d01-c0d0-45c7-be17-59d3befbfc03-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:21.686123 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:21.685987    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dp8b\" (UniqueName: \"kubernetes.io/projected/710c0d01-c0d0-45c7-be17-59d3befbfc03-kube-api-access-6dp8b\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:26:22.316844 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.316807    2578 generic.go:356] "Generic (PLEG): container finished" podID="710c0d01-c0d0-45c7-be17-59d3befbfc03" containerID="3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916" exitCode=0
Sep 09 16:26:22.317259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.316853    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-stqcb"
Sep 09 16:26:22.317259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.316855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-stqcb" event={"ID":"710c0d01-c0d0-45c7-be17-59d3befbfc03","Type":"ContainerDied","Data":"3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916"}
Sep 09 16:26:22.317259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.316909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-stqcb" event={"ID":"710c0d01-c0d0-45c7-be17-59d3befbfc03","Type":"ContainerDied","Data":"2680a7e95864763c3c5d2e15d8652fc09d3cf7fc170004904591046c2f180003"}
Sep 09 16:26:22.317259 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.316939    2578 scope.go:117] "RemoveContainer" containerID="3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916"
Sep 09 16:26:22.327425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.327407    2578 scope.go:117] "RemoveContainer" containerID="3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916"
Sep 09 16:26:22.327710 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:26:22.327690    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916\": container with ID starting with 3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916 not found: ID does not exist" containerID="3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916"
Sep 09 16:26:22.327756 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.327718    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916"} err="failed to get container status \"3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916\": rpc error: code = NotFound desc = could not find container \"3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916\": container with ID starting with 3dbb48dede1044ac40a0f77dbdaba9671b6dc8e8a76be9b1a808534c65f82916 not found: ID does not exist"
Sep 09 16:26:22.338930 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.338904    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-stqcb"]
Sep 09 16:26:22.342501 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:22.342483    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-stqcb"]
Sep 09 16:26:23.368465 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:26:23.368431    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710c0d01-c0d0-45c7-be17-59d3befbfc03" path="/var/lib/kubelet/pods/710c0d01-c0d0-45c7-be17-59d3befbfc03/volumes"
Sep 09 16:27:23.152449 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152332    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-5jwrc"]
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152833    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7130ba5c-3ec9-4eb3-83ac-137157edbfe1" containerName="maas-api"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152850    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7130ba5c-3ec9-4eb3-83ac-137157edbfe1" containerName="maas-api"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152860    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e8270e-f297-425b-9e80-4b9f4921ce4b" containerName="payload-processing"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152866    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e8270e-f297-425b-9e80-4b9f4921ce4b" containerName="payload-processing"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152877    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bc2ed4-52e8-4158-b6f7-9e358fde5832" containerName="maas-api"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152883    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bc2ed4-52e8-4158-b6f7-9e358fde5832" containerName="maas-api"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152891    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710c0d01-c0d0-45c7-be17-59d3befbfc03" containerName="manager"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152896    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="710c0d01-c0d0-45c7-be17-59d3befbfc03" containerName="manager"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152903    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152908    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152914    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152919    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152928    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152933    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152946    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" containerName="payload-processing"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152951    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" containerName="payload-processing"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152963    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" containerName="maas-api"
Sep 09 16:27:23.152956 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.152969    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" containerName="maas-api"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153046    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="710c0d01-c0d0-45c7-be17-59d3befbfc03" containerName="manager"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153054    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153061    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e8270e-f297-425b-9e80-4b9f4921ce4b" containerName="payload-processing"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153068    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153075    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ec5d7c-21b7-4396-99dd-8a76e2c75eaf" containerName="payload-processing"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153080    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23bc2ed4-52e8-4158-b6f7-9e358fde5832" containerName="maas-api"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153084    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153089    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc49201e-a967-4246-852b-29eee6180fe3" containerName="istio-proxy"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153094    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce61c741-9c11-4bf7-860a-a5c5a7d7bd1f" containerName="maas-api"
Sep 09 16:27:23.153553 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.153100    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7130ba5c-3ec9-4eb3-83ac-137157edbfe1" containerName="maas-api"
Sep 09 16:27:23.156342 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.156319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.160434 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.160402    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:27:23.160434 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.160426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w87qf\""
Sep 09 16:27:23.160656 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.160438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:27:23.160656 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.160438    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:27:23.172867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.172840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-5jwrc"]
Sep 09 16:27:23.196542 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.196511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgs9t\" (UniqueName: \"kubernetes.io/projected/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-kube-api-access-kgs9t\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.196820 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.196795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-webhook-cert\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.196928 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.196906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-metrics-certs\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.298111 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.298088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgs9t\" (UniqueName: \"kubernetes.io/projected/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-kube-api-access-kgs9t\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.298248 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.298133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-webhook-cert\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.298318 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.298254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-metrics-certs\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.300767 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.300742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-webhook-cert\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.300858 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.300742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-metrics-certs\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.305392 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.305360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgs9t\" (UniqueName: \"kubernetes.io/projected/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-kube-api-access-kgs9t\") pod \"maas-controller-7b4d875bf9-5jwrc\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") " pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.467959 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.467936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:23.743149 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.743126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-5jwrc"]
Sep 09 16:27:23.744718 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:27:23.744690    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec0daa3_874b_4f7a_8710_1f0fa71316a1.slice/crio-8c9ff12a8523b4d042503e546e75598fc826a044b6d61e1cf4f90c49e16214c1 WatchSource:0}: Error finding container 8c9ff12a8523b4d042503e546e75598fc826a044b6d61e1cf4f90c49e16214c1: Status 404 returned error can't find the container with id 8c9ff12a8523b4d042503e546e75598fc826a044b6d61e1cf4f90c49e16214c1
Sep 09 16:27:23.746007 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:23.745987    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:27:24.644715 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:24.644617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc" event={"ID":"9ec0daa3-874b-4f7a-8710-1f0fa71316a1","Type":"ContainerStarted","Data":"5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722"}
Sep 09 16:27:24.644715 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:24.644701    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:24.645088 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:24.644726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc" event={"ID":"9ec0daa3-874b-4f7a-8710-1f0fa71316a1","Type":"ContainerStarted","Data":"8c9ff12a8523b4d042503e546e75598fc826a044b6d61e1cf4f90c49e16214c1"}
Sep 09 16:27:24.661935 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:24.661883    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc" podStartSLOduration=1.033383793 podStartE2EDuration="1.661863323s" totalImagesPullingTime="628.47953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:24.66159647 +0000 UTC m=+2155.922725647" watchObservedRunningTime="2026-09-09 16:27:24.661863323 +0000 UTC m=+2155.922992502"
Sep 09 16:27:35.651282 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:35.651253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:45.063217 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.063176    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-5jwrc"]
Sep 09 16:27:45.063700 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.063430    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc" podUID="9ec0daa3-874b-4f7a-8710-1f0fa71316a1" containerName="manager" containerID="cri-o://5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722" gracePeriod=30
Sep 09 16:27:45.417089 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.417067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:45.490485 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.490452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-webhook-cert\") pod \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") "
Sep 09 16:27:45.490627 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.490537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgs9t\" (UniqueName: \"kubernetes.io/projected/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-kube-api-access-kgs9t\") pod \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") "
Sep 09 16:27:45.490627 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.490575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-metrics-certs\") pod \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\" (UID: \"9ec0daa3-874b-4f7a-8710-1f0fa71316a1\") "
Sep 09 16:27:45.492567 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.492534    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9ec0daa3-874b-4f7a-8710-1f0fa71316a1" (UID: "9ec0daa3-874b-4f7a-8710-1f0fa71316a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:45.492714 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.492598    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-kube-api-access-kgs9t" (OuterVolumeSpecName: "kube-api-access-kgs9t") pod "9ec0daa3-874b-4f7a-8710-1f0fa71316a1" (UID: "9ec0daa3-874b-4f7a-8710-1f0fa71316a1"). InnerVolumeSpecName "kube-api-access-kgs9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:45.492714 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.492652    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9ec0daa3-874b-4f7a-8710-1f0fa71316a1" (UID: "9ec0daa3-874b-4f7a-8710-1f0fa71316a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:45.591551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.591482    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-webhook-cert\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:27:45.591551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.591506    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgs9t\" (UniqueName: \"kubernetes.io/projected/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-kube-api-access-kgs9t\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:27:45.591551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.591515    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ec0daa3-874b-4f7a-8710-1f0fa71316a1-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:27:45.760183 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.760154    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ec0daa3-874b-4f7a-8710-1f0fa71316a1" containerID="5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722" exitCode=0
Sep 09 16:27:45.760324 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.760200    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc"
Sep 09 16:27:45.760324 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.760233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc" event={"ID":"9ec0daa3-874b-4f7a-8710-1f0fa71316a1","Type":"ContainerDied","Data":"5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722"}
Sep 09 16:27:45.760324 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.760279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-5jwrc" event={"ID":"9ec0daa3-874b-4f7a-8710-1f0fa71316a1","Type":"ContainerDied","Data":"8c9ff12a8523b4d042503e546e75598fc826a044b6d61e1cf4f90c49e16214c1"}
Sep 09 16:27:45.760324 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.760302    2578 scope.go:117] "RemoveContainer" containerID="5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722"
Sep 09 16:27:45.769825 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.769807    2578 scope.go:117] "RemoveContainer" containerID="5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722"
Sep 09 16:27:45.770092 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:27:45.770073    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722\": container with ID starting with 5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722 not found: ID does not exist" containerID="5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722"
Sep 09 16:27:45.770185 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.770097    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722"} err="failed to get container status \"5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722\": rpc error: code = NotFound desc = could not find container \"5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722\": container with ID starting with 5fb8344c585561a4a577df1af0d660d05b8b4fba663dd82c0cde53388687f722 not found: ID does not exist"
Sep 09 16:27:45.783438 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.783408    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-5jwrc"]
Sep 09 16:27:45.787676 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:45.787656    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-5jwrc"]
Sep 09 16:27:46.795595 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.795566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-gqskf"]
Sep 09 16:27:46.795973 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.795922    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec0daa3-874b-4f7a-8710-1f0fa71316a1" containerName="manager"
Sep 09 16:27:46.795973 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.795933    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec0daa3-874b-4f7a-8710-1f0fa71316a1" containerName="manager"
Sep 09 16:27:46.795973 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.795957    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy"
Sep 09 16:27:46.795973 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.795971    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07419953-e253-4bee-9f76-b07ec61ee9e7" containerName="istio-proxy"
Sep 09 16:27:46.796208 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.796060    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec0daa3-874b-4f7a-8710-1f0fa71316a1" containerName="manager"
Sep 09 16:27:46.800116 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.800099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:46.803730 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.803707    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:27:46.803730 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.803727    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w87qf\""
Sep 09 16:27:46.803899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.803765    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:27:46.803899 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.803788    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:27:46.812151 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.812121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-gqskf"]
Sep 09 16:27:46.902734 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.902703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-webhook-cert\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:46.902867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.902756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-metrics-certs\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:46.902867 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:46.902835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9s25\" (UniqueName: \"kubernetes.io/projected/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-kube-api-access-z9s25\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.003609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.003578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9s25\" (UniqueName: \"kubernetes.io/projected/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-kube-api-access-z9s25\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.003731 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.003650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-webhook-cert\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.003731 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.003698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-metrics-certs\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.006189 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.006157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-metrics-certs\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.006285 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.006157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-webhook-cert\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.012752 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.012727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9s25\" (UniqueName: \"kubernetes.io/projected/76ea68dc-ffc6-408f-8cea-99b4dd34fe74-kube-api-access-z9s25\") pod \"maas-controller-7b4d875bf9-gqskf\" (UID: \"76ea68dc-ffc6-408f-8cea-99b4dd34fe74\") " pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.112999 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.112949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:47.368268 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.368196    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec0daa3-874b-4f7a-8710-1f0fa71316a1" path="/var/lib/kubelet/pods/9ec0daa3-874b-4f7a-8710-1f0fa71316a1/volumes"
Sep 09 16:27:47.387557 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.387535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4d875bf9-gqskf"]
Sep 09 16:27:47.388788 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:27:47.388762    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ea68dc_ffc6_408f_8cea_99b4dd34fe74.slice/crio-6466048c13db8e8e85bd1d2591dbc2b52bc11be74a78932c7b4857de0231af81 WatchSource:0}: Error finding container 6466048c13db8e8e85bd1d2591dbc2b52bc11be74a78932c7b4857de0231af81: Status 404 returned error can't find the container with id 6466048c13db8e8e85bd1d2591dbc2b52bc11be74a78932c7b4857de0231af81
Sep 09 16:27:47.774152 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:47.774122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-gqskf" event={"ID":"76ea68dc-ffc6-408f-8cea-99b4dd34fe74","Type":"ContainerStarted","Data":"6466048c13db8e8e85bd1d2591dbc2b52bc11be74a78932c7b4857de0231af81"}
Sep 09 16:27:49.791627 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:49.791587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4d875bf9-gqskf" event={"ID":"76ea68dc-ffc6-408f-8cea-99b4dd34fe74","Type":"ContainerStarted","Data":"3eb50f9495ef1d24d84e97d4a038b61041e79bc32ca066cb7cbe7ab5b7274e80"}
Sep 09 16:27:49.792084 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:49.791668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:27:49.809334 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:27:49.809290    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b4d875bf9-gqskf" podStartSLOduration=1.818828721 podStartE2EDuration="3.809278044s" totalImagesPullingTime="1.990449323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:49.80789437 +0000 UTC m=+2181.069023574" watchObservedRunningTime="2026-09-09 16:27:49.809278044 +0000 UTC m=+2181.070407220"
Sep 09 16:28:00.799947 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:28:00.799917    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b4d875bf9-gqskf"
Sep 09 16:29:07.790017 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:07.789978    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"]
Sep 09 16:29:07.792547 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:07.790202    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv" podUID="7f4d0d33-446e-4c3e-928a-466a0664fac0" containerName="manager" containerID="cri-o://cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d" gracePeriod=10
Sep 09 16:29:08.050732 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.050678    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:29:08.125472 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.125436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f4d0d33-446e-4c3e-928a-466a0664fac0-extensions-socket-volume\") pod \"7f4d0d33-446e-4c3e-928a-466a0664fac0\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") "
Sep 09 16:29:08.125659 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.125482    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtdmb\" (UniqueName: \"kubernetes.io/projected/7f4d0d33-446e-4c3e-928a-466a0664fac0-kube-api-access-qtdmb\") pod \"7f4d0d33-446e-4c3e-928a-466a0664fac0\" (UID: \"7f4d0d33-446e-4c3e-928a-466a0664fac0\") "
Sep 09 16:29:08.125819 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.125791    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4d0d33-446e-4c3e-928a-466a0664fac0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7f4d0d33-446e-4c3e-928a-466a0664fac0" (UID: "7f4d0d33-446e-4c3e-928a-466a0664fac0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:29:08.127586 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.127560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4d0d33-446e-4c3e-928a-466a0664fac0-kube-api-access-qtdmb" (OuterVolumeSpecName: "kube-api-access-qtdmb") pod "7f4d0d33-446e-4c3e-928a-466a0664fac0" (UID: "7f4d0d33-446e-4c3e-928a-466a0664fac0"). InnerVolumeSpecName "kube-api-access-qtdmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:29:08.226567 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.226536    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f4d0d33-446e-4c3e-928a-466a0664fac0-extensions-socket-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:29:08.226567 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.226560    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtdmb\" (UniqueName: \"kubernetes.io/projected/7f4d0d33-446e-4c3e-928a-466a0664fac0-kube-api-access-qtdmb\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:29:08.230964 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.230938    2578 generic.go:356] "Generic (PLEG): container finished" podID="7f4d0d33-446e-4c3e-928a-466a0664fac0" containerID="cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d" exitCode=0
Sep 09 16:29:08.231090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.230976    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"
Sep 09 16:29:08.231090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.231017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv" event={"ID":"7f4d0d33-446e-4c3e-928a-466a0664fac0","Type":"ContainerDied","Data":"cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d"}
Sep 09 16:29:08.231090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.231064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv" event={"ID":"7f4d0d33-446e-4c3e-928a-466a0664fac0","Type":"ContainerDied","Data":"be1caed394f79f8fcbd714cc29fd90bb72bbd2ed61181dd19312a9a0b42bc5be"}
Sep 09 16:29:08.231090 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.231089    2578 scope.go:117] "RemoveContainer" containerID="cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d"
Sep 09 16:29:08.241305 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.241289    2578 scope.go:117] "RemoveContainer" containerID="cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d"
Sep 09 16:29:08.241603 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:29:08.241585    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d\": container with ID starting with cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d not found: ID does not exist" containerID="cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d"
Sep 09 16:29:08.241668 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.241640    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d"} err="failed to get container status \"cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d\": rpc error: code = NotFound desc = could not find container \"cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d\": container with ID starting with cf1f27b7d65de8432819bc69f2573f7d4386fcce442125407b2313fb13d1920d not found: ID does not exist"
Sep 09 16:29:08.252794 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.252773    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"]
Sep 09 16:29:08.255761 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:08.255741    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dn9rv"]
Sep 09 16:29:09.368828 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:29:09.368797    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f4d0d33-446e-4c3e-928a-466a0664fac0" path="/var/lib/kubelet/pods/7f4d0d33-446e-4c3e-928a-466a0664fac0/volumes"
Sep 09 16:30:08.517223 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.517186    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"]
Sep 09 16:30:08.517707 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.517573    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4d0d33-446e-4c3e-928a-466a0664fac0" containerName="manager"
Sep 09 16:30:08.517707 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.517585    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4d0d33-446e-4c3e-928a-466a0664fac0" containerName="manager"
Sep 09 16:30:08.517707 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.517645    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f4d0d33-446e-4c3e-928a-466a0664fac0" containerName="manager"
Sep 09 16:30:08.520621 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.520604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.523465 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.523442    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lgrv5\""
Sep 09 16:30:08.533266 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.533244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"]
Sep 09 16:30:08.588727 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.588696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84110c5f-1934-4f56-b382-d26b03e0179f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lthsg\" (UID: \"84110c5f-1934-4f56-b382-d26b03e0179f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.588834 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.588783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpv7\" (UniqueName: \"kubernetes.io/projected/84110c5f-1934-4f56-b382-d26b03e0179f-kube-api-access-plpv7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lthsg\" (UID: \"84110c5f-1934-4f56-b382-d26b03e0179f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.689291 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.689264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpv7\" (UniqueName: \"kubernetes.io/projected/84110c5f-1934-4f56-b382-d26b03e0179f-kube-api-access-plpv7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lthsg\" (UID: \"84110c5f-1934-4f56-b382-d26b03e0179f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.689462 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.689332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84110c5f-1934-4f56-b382-d26b03e0179f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lthsg\" (UID: \"84110c5f-1934-4f56-b382-d26b03e0179f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.689696 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.689680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84110c5f-1934-4f56-b382-d26b03e0179f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lthsg\" (UID: \"84110c5f-1934-4f56-b382-d26b03e0179f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.699202 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.699179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpv7\" (UniqueName: \"kubernetes.io/projected/84110c5f-1934-4f56-b382-d26b03e0179f-kube-api-access-plpv7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lthsg\" (UID: \"84110c5f-1934-4f56-b382-d26b03e0179f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:08.831489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:08.831425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:09.121775 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:09.121748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"]
Sep 09 16:30:09.122929 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:30:09.122905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84110c5f_1934_4f56_b382_d26b03e0179f.slice/crio-270b95ec3818c9f49af97838803a9133f2fe80f6b5d5b27885d3495256b25765 WatchSource:0}: Error finding container 270b95ec3818c9f49af97838803a9133f2fe80f6b5d5b27885d3495256b25765: Status 404 returned error can't find the container with id 270b95ec3818c9f49af97838803a9133f2fe80f6b5d5b27885d3495256b25765
Sep 09 16:30:09.569039 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:09.568997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg" event={"ID":"84110c5f-1934-4f56-b382-d26b03e0179f","Type":"ContainerStarted","Data":"c425c3e15b9925deb8333dafd864fa191931b4d6d8d265e726ad9b37762de6f1"}
Sep 09 16:30:09.569448 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:09.569056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg" event={"ID":"84110c5f-1934-4f56-b382-d26b03e0179f","Type":"ContainerStarted","Data":"270b95ec3818c9f49af97838803a9133f2fe80f6b5d5b27885d3495256b25765"}
Sep 09 16:30:09.569448 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:09.569253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:30:09.594332 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:09.594283    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg" podStartSLOduration=1.594269119 podStartE2EDuration="1.594269119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:30:09.59140024 +0000 UTC m=+2320.852529406" watchObservedRunningTime="2026-09-09 16:30:09.594269119 +0000 UTC m=+2320.855398295"
Sep 09 16:30:20.577456 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:30:20.577419    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lthsg"
Sep 09 16:31:56.466704 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.466667    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"]
Sep 09 16:31:56.476411 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.475786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.483507 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.483477    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"]
Sep 09 16:31:56.584438 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.584398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2lf\" (UniqueName: \"kubernetes.io/projected/30a05548-bbf6-4125-9cf4-794c40c7e54e-kube-api-access-6z2lf\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.584637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.584518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a05548-bbf6-4125-9cf4-794c40c7e54e-metrics-certs\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.584637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.584564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a05548-bbf6-4125-9cf4-794c40c7e54e-openshift-service-ca\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.584637 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.584600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a05548-bbf6-4125-9cf4-794c40c7e54e-maas-api-tls\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.685631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.685544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a05548-bbf6-4125-9cf4-794c40c7e54e-metrics-certs\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.685631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.685588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a05548-bbf6-4125-9cf4-794c40c7e54e-openshift-service-ca\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.685631 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.685612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a05548-bbf6-4125-9cf4-794c40c7e54e-maas-api-tls\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.685927 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.685651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2lf\" (UniqueName: \"kubernetes.io/projected/30a05548-bbf6-4125-9cf4-794c40c7e54e-kube-api-access-6z2lf\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.686383 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.686331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a05548-bbf6-4125-9cf4-794c40c7e54e-openshift-service-ca\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.688669 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.688642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a05548-bbf6-4125-9cf4-794c40c7e54e-metrics-certs\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.688806 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.688686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a05548-bbf6-4125-9cf4-794c40c7e54e-maas-api-tls\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.693482 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.693460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2lf\" (UniqueName: \"kubernetes.io/projected/30a05548-bbf6-4125-9cf4-794c40c7e54e-kube-api-access-6z2lf\") pod \"maas-api-8585bfb869-stxq4\" (UID: \"30a05548-bbf6-4125-9cf4-794c40c7e54e\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:56.792527 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:56.792493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:57.066134 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:57.066102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"]
Sep 09 16:31:57.067470 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:31:57.067445    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a05548_bbf6_4125_9cf4_794c40c7e54e.slice/crio-2dd81b03d53e58fcd4dd904b3e8fb4dab76a23e85dcc7e6b1d42e83735997fed WatchSource:0}: Error finding container 2dd81b03d53e58fcd4dd904b3e8fb4dab76a23e85dcc7e6b1d42e83735997fed: Status 404 returned error can't find the container with id 2dd81b03d53e58fcd4dd904b3e8fb4dab76a23e85dcc7e6b1d42e83735997fed
Sep 09 16:31:57.147446 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:57.147406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4" event={"ID":"30a05548-bbf6-4125-9cf4-794c40c7e54e","Type":"ContainerStarted","Data":"2dd81b03d53e58fcd4dd904b3e8fb4dab76a23e85dcc7e6b1d42e83735997fed"}
Sep 09 16:31:58.154045 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:58.154007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4" event={"ID":"30a05548-bbf6-4125-9cf4-794c40c7e54e","Type":"ContainerStarted","Data":"6a018862315b89bfa1cf454ac6d2fa27bf5fa6a163e666330df0612696e5b335"}
Sep 09 16:31:58.154550 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:58.154135    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:31:58.172788 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:31:58.172741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4" podStartSLOduration=1.7302687369999998 podStartE2EDuration="2.172726729s" totalImagesPullingTime="442.457992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:31:58.171275956 +0000 UTC m=+2429.432405136" watchObservedRunningTime="2026-09-09 16:31:58.172726729 +0000 UTC m=+2429.433855906"
Sep 09 16:32:04.166538 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:04.166507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8585bfb869-stxq4"
Sep 09 16:32:04.215123 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:04.215090    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"]
Sep 09 16:32:04.215300 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:04.215276    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" podUID="4caf2c22-7708-4775-97b9-9f500035b25b" containerName="maas-api" containerID="cri-o://05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68" gracePeriod=30
Sep 09 16:32:04.983705 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:04.983660    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" podUID="4caf2c22-7708-4775-97b9-9f500035b25b" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.49:8443/health\": dial tcp 10.133.0.49:8443: connect: connection refused"
Sep 09 16:32:05.459496 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.459470    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:32:05.565310 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.565221    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6srp\" (UniqueName: \"kubernetes.io/projected/4caf2c22-7708-4775-97b9-9f500035b25b-kube-api-access-w6srp\") pod \"4caf2c22-7708-4775-97b9-9f500035b25b\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") "
Sep 09 16:32:05.565310 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.565266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-maas-api-tls\") pod \"4caf2c22-7708-4775-97b9-9f500035b25b\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") "
Sep 09 16:32:05.565562 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.565336    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-metrics-certs\") pod \"4caf2c22-7708-4775-97b9-9f500035b25b\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") "
Sep 09 16:32:05.565562 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.565375    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf2c22-7708-4775-97b9-9f500035b25b-openshift-service-ca\") pod \"4caf2c22-7708-4775-97b9-9f500035b25b\" (UID: \"4caf2c22-7708-4775-97b9-9f500035b25b\") "
Sep 09 16:32:05.565804 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.565773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4caf2c22-7708-4775-97b9-9f500035b25b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4caf2c22-7708-4775-97b9-9f500035b25b" (UID: "4caf2c22-7708-4775-97b9-9f500035b25b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:32:05.567474 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.567450    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4caf2c22-7708-4775-97b9-9f500035b25b-kube-api-access-w6srp" (OuterVolumeSpecName: "kube-api-access-w6srp") pod "4caf2c22-7708-4775-97b9-9f500035b25b" (UID: "4caf2c22-7708-4775-97b9-9f500035b25b"). InnerVolumeSpecName "kube-api-access-w6srp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:32:05.567569 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.567478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4caf2c22-7708-4775-97b9-9f500035b25b" (UID: "4caf2c22-7708-4775-97b9-9f500035b25b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:32:05.567569 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.567502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4caf2c22-7708-4775-97b9-9f500035b25b" (UID: "4caf2c22-7708-4775-97b9-9f500035b25b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:32:05.666283 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.666250    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-metrics-certs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:32:05.666283 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.666281    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf2c22-7708-4775-97b9-9f500035b25b-openshift-service-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:32:05.666498 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.666293    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6srp\" (UniqueName: \"kubernetes.io/projected/4caf2c22-7708-4775-97b9-9f500035b25b-kube-api-access-w6srp\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:32:05.666498 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:05.666304    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf2c22-7708-4775-97b9-9f500035b25b-maas-api-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Sep 09 16:32:06.204031 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.203972    2578 generic.go:356] "Generic (PLEG): container finished" podID="4caf2c22-7708-4775-97b9-9f500035b25b" containerID="05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68" exitCode=0
Sep 09 16:32:06.204031 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.204013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"
Sep 09 16:32:06.204291 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.204061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" event={"ID":"4caf2c22-7708-4775-97b9-9f500035b25b","Type":"ContainerDied","Data":"05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68"}
Sep 09 16:32:06.204291 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.204118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72" event={"ID":"4caf2c22-7708-4775-97b9-9f500035b25b","Type":"ContainerDied","Data":"d08aab96dab64b13095612a2ccdd0dd409a0af4f25bfa52543d3d62fe395b49a"}
Sep 09 16:32:06.204291 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.204143    2578 scope.go:117] "RemoveContainer" containerID="05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68"
Sep 09 16:32:06.214224 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.214202    2578 scope.go:117] "RemoveContainer" containerID="05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68"
Sep 09 16:32:06.214542 ip-10-0-135-66 kubenswrapper[2578]: E0909 16:32:06.214521    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68\": container with ID starting with 05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68 not found: ID does not exist" containerID="05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68"
Sep 09 16:32:06.214617 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.214549    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68"} err="failed to get container status \"05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68\": rpc error: code = NotFound desc = could not find container \"05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68\": container with ID starting with 05672ce4704b42f4ef6aac3eff04c82ceb80b22cb96986887b0a696b792e4c68 not found: ID does not exist"
Sep 09 16:32:06.225159 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.225136    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"]
Sep 09 16:32:06.228922 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:06.228900    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-9bg72"]
Sep 09 16:32:07.368081 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:07.368046    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4caf2c22-7708-4775-97b9-9f500035b25b" path="/var/lib/kubelet/pods/4caf2c22-7708-4775-97b9-9f500035b25b/volumes"
Sep 09 16:32:33.338896 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:33.338859    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b4d875bf9-gqskf_76ea68dc-ffc6-408f-8cea-99b4dd34fe74/manager/0.log"
Sep 09 16:32:33.579479 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:33.579451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5c6rx_efc75cd1-f882-4d22-81b2-47ee45c19d06/manager/0.log"
Sep 09 16:32:33.962260 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:33.962197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4ccd886c-s8d7q_1176bd3e-a4ec-4d82-8638-6e58c3aaab69/manager/0.log"
Sep 09 16:32:33.968562 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:33.968543    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4ccd886c-s8d7q_1176bd3e-a4ec-4d82-8638-6e58c3aaab69/copy-manifests/0.log"
Sep 09 16:32:34.456481 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:34.456455    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8585bfb869-stxq4_30a05548-bbf6-4125-9cf4-794c40c7e54e/maas-api/0.log"
Sep 09 16:32:34.810703 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:34.810625    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-nfrql_3613e5f2-c90e-42c1-bf18-f98ebde128a8/postgres/0.log"
Sep 09 16:32:36.105968 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:36.105932    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-lthsg_84110c5f-1934-4f56-b382-d26b03e0179f/manager/0.log"
Sep 09 16:32:36.352129 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:36.352094    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-lpgsg_3ea1abdf-c837-4769-869f-b39a2a8e573b/manager/0.log"
Sep 09 16:32:36.841721 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:36.841690    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dd6l7_b19b88eb-885f-45bc-a0f1-8d1c983026b8/discovery/0.log"
Sep 09 16:32:36.958489 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:36.958437    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747b697884-hfp2m_00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82/kube-auth-proxy/0.log"
Sep 09 16:32:37.471816 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:37.471787    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pw6qh_816139fc-4aa6-4afe-9ad4-37008de3b432/payload-processing/0.log"
Sep 09 16:32:37.587594 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:37.587563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775cbbfd5d-w7f9r_a3c9e417-88aa-49fc-afaf-8c0988eaf278/router/0.log"
Sep 09 16:32:38.211230 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:38.211201    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-wbjpk_7c9b98b5-eb7e-4c34-8d24-e949306fab49/main/0.log"
Sep 09 16:32:38.567515 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:38.567431    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dp2z8_53c83cc9-f6ed-43dd-b9bd-076101be028c/main/0.log"
Sep 09 16:32:47.111601 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:47.111567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jh87r_772acdbb-e881-40f6-a089-39847b812c67/global-pull-secret-syncer/0.log"
Sep 09 16:32:47.252235 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:47.252200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-clqfs_1d98ce2b-aeb8-4918-bcd2-0a64418b2327/konnectivity-agent/0.log"
Sep 09 16:32:47.348630 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:47.348593    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-66.ec2.internal_91430b5bb44a10f38fd89646c1d4f49d/haproxy/0.log"
Sep 09 16:32:51.686609 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:51.686581    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-lthsg_84110c5f-1934-4f56-b382-d26b03e0179f/manager/0.log"
Sep 09 16:32:51.799760 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:51.799717    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-lpgsg_3ea1abdf-c837-4769-869f-b39a2a8e573b/manager/0.log"
Sep 09 16:32:53.675806 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.675744    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6584bb4c58-p2nf9_6eeca564-4767-4295-96fe-68fa003d7811/metrics-server/0.log"
Sep 09 16:32:53.700321 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.700295    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-ttpgj_a332eb9c-b3ad-41a4-a4e4-a2ed26b561b8/monitoring-plugin/0.log"
Sep 09 16:32:53.812362 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.812326    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-84z7g_7583047d-1d22-4fd0-8973-992336708cf9/node-exporter/0.log"
Sep 09 16:32:53.831989 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.831961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-84z7g_7583047d-1d22-4fd0-8973-992336708cf9/kube-rbac-proxy/0.log"
Sep 09 16:32:53.851891 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.851872    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-84z7g_7583047d-1d22-4fd0-8973-992336708cf9/init-textfile/0.log"
Sep 09 16:32:53.960165 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.960144    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-6wrkr_615a6b98-a497-4cb1-8ef6-0210ec02d755/kube-rbac-proxy-main/0.log"
Sep 09 16:32:53.982987 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:53.982921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-6wrkr_615a6b98-a497-4cb1-8ef6-0210ec02d755/kube-rbac-proxy-self/0.log"
Sep 09 16:32:54.003751 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:54.003731    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-6wrkr_615a6b98-a497-4cb1-8ef6-0210ec02d755/openshift-state-metrics/0.log"
Sep 09 16:32:54.217144 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:54.217042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9nvfr_9d719d7f-eaeb-4490-82da-038fd28eaaf7/prometheus-operator/0.log"
Sep 09 16:32:54.236087 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:54.236066    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9nvfr_9d719d7f-eaeb-4490-82da-038fd28eaaf7/kube-rbac-proxy/0.log"
Sep 09 16:32:57.128075 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:57.128038    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-559fb8446f-vxg4x_ad2dd456-a215-4bdc-a7cb-050bef655bea/console/0.log"
Sep 09 16:32:58.936233 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:58.936199    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbctk_71a5085d-b887-48ae-9152-d715e6d61760/dns/0.log"
Sep 09 16:32:58.959023 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:58.958999    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbctk_71a5085d-b887-48ae-9152-d715e6d61760/kube-rbac-proxy/0.log"
Sep 09 16:32:59.093018 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:59.092990    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ngqh9_ffd551af-92b3-49f6-88f8-0c44a905315a/dns-node-resolver/0.log"
Sep 09 16:32:59.630425 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:59.630395    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66867985d6-jq2lj_54fc8590-8a0a-4651-ba47-5b1cbcd25ae9/registry/0.log"
Sep 09 16:32:59.673645 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:32:59.673608    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vtphj_842b9ceb-3fe2-4598-9103-e4ea19c2bacb/node-ca/0.log"
Sep 09 16:33:00.793613 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:00.793556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dd6l7_b19b88eb-885f-45bc-a0f1-8d1c983026b8/discovery/0.log"
Sep 09 16:33:00.813592 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:00.813553    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747b697884-hfp2m_00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82/kube-auth-proxy/0.log"
Sep 09 16:33:00.957921 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:00.957866    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pw6qh_816139fc-4aa6-4afe-9ad4-37008de3b432/payload-processing/0.log"
Sep 09 16:33:00.981825 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:00.981795    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775cbbfd5d-w7f9r_a3c9e417-88aa-49fc-afaf-8c0988eaf278/router/0.log"
Sep 09 16:33:01.861731 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:01.861699    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6gfk_42257bc1-4d2a-4d3e-884b-fecce892dffa/serve-healthcheck-canary/0.log"
Sep 09 16:33:02.345905 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.345871    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-25ztf_7dd47e64-abdc-4819-a238-8548a75af6b7/insights-operator/0.log"
Sep 09 16:33:02.346085 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.345982    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-25ztf_7dd47e64-abdc-4819-a238-8548a75af6b7/insights-operator/1.log"
Sep 09 16:33:02.503626 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.503595    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-64pkg_3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb/kube-rbac-proxy/0.log"
Sep 09 16:33:02.523022 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.522992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-64pkg_3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb/exporter/0.log"
Sep 09 16:33:02.542624 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.542585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-64pkg_3bad9cd4-ee7b-4099-9d5d-18b15c4e11bb/extractor/0.log"
Sep 09 16:33:02.987122 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.987088    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"]
Sep 09 16:33:02.987694 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.987670    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4caf2c22-7708-4775-97b9-9f500035b25b" containerName="maas-api"
Sep 09 16:33:02.987786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.987696    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4caf2c22-7708-4775-97b9-9f500035b25b" containerName="maas-api"
Sep 09 16:33:02.987841 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.987816    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4caf2c22-7708-4775-97b9-9f500035b25b" containerName="maas-api"
Sep 09 16:33:02.991104 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.991084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:02.994216 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.994191    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g6q5c\"/\"default-dockercfg-92n2g\""
Sep 09 16:33:02.994314 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.994215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g6q5c\"/\"openshift-service-ca.crt\""
Sep 09 16:33:02.995803 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.995785    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g6q5c\"/\"kube-root-ca.crt\""
Sep 09 16:33:02.999011 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:02.998994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"]
Sep 09 16:33:03.090218 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.090192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-lib-modules\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.090323 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.090250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbc97\" (UniqueName: \"kubernetes.io/projected/fb6fc708-880c-44ed-897a-330f47e54c5c-kube-api-access-xbc97\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.090406 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.090386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-sys\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.090449 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.090421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-podres\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.090485 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.090448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-proc\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191670 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-sys\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-podres\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-proc\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191786 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-lib-modules\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbc97\" (UniqueName: \"kubernetes.io/projected/fb6fc708-880c-44ed-897a-330f47e54c5c-kube-api-access-xbc97\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-podres\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-sys\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-lib-modules\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.191929 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.191757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb6fc708-880c-44ed-897a-330f47e54c5c-proc\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.212750 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.212730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbc97\" (UniqueName: \"kubernetes.io/projected/fb6fc708-880c-44ed-897a-330f47e54c5c-kube-api-access-xbc97\") pod \"perf-node-gather-daemonset-xqbjr\" (UID: \"fb6fc708-880c-44ed-897a-330f47e54c5c\") " pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.302392 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.302314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:03.578547 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:03.578520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"]
Sep 09 16:33:03.580125 ip-10-0-135-66 kubenswrapper[2578]: W0909 16:33:03.580097    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb6fc708_880c_44ed_897a_330f47e54c5c.slice/crio-cadc52abd56823620fde98a330152d59c841366ed581252b9f924fcaa7bf6dab WatchSource:0}: Error finding container cadc52abd56823620fde98a330152d59c841366ed581252b9f924fcaa7bf6dab: Status 404 returned error can't find the container with id cadc52abd56823620fde98a330152d59c841366ed581252b9f924fcaa7bf6dab
Sep 09 16:33:04.521457 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:04.521422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr" event={"ID":"fb6fc708-880c-44ed-897a-330f47e54c5c","Type":"ContainerStarted","Data":"f72c40932fe271fb9b9403294a3ebdd48fc528c2447a09e596c9ed9ab29eed6b"}
Sep 09 16:33:04.521931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:04.521482    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:04.521931 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:04.521498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr" event={"ID":"fb6fc708-880c-44ed-897a-330f47e54c5c","Type":"ContainerStarted","Data":"cadc52abd56823620fde98a330152d59c841366ed581252b9f924fcaa7bf6dab"}
Sep 09 16:33:04.538541 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:04.538485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr" podStartSLOduration=2.538469086 podStartE2EDuration="2.538469086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:33:04.536008367 +0000 UTC m=+2495.797137544" watchObservedRunningTime="2026-09-09 16:33:04.538469086 +0000 UTC m=+2495.799598261"
Sep 09 16:33:05.044936 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:05.044907    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b4d875bf9-gqskf_76ea68dc-ffc6-408f-8cea-99b4dd34fe74/manager/0.log"
Sep 09 16:33:05.138182 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:05.138147    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5c6rx_efc75cd1-f882-4d22-81b2-47ee45c19d06/manager/0.log"
Sep 09 16:33:05.302227 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:05.302145    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4ccd886c-s8d7q_1176bd3e-a4ec-4d82-8638-6e58c3aaab69/manager/0.log"
Sep 09 16:33:05.322190 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:05.322165    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4ccd886c-s8d7q_1176bd3e-a4ec-4d82-8638-6e58c3aaab69/copy-manifests/0.log"
Sep 09 16:33:07.654367 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:07.654314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dd6l7_b19b88eb-885f-45bc-a0f1-8d1c983026b8/discovery/0.log"
Sep 09 16:33:07.664068 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:07.664045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747b697884-hfp2m_00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82/kube-auth-proxy/0.log"
Sep 09 16:33:07.767798 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:07.767771    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pw6qh_816139fc-4aa6-4afe-9ad4-37008de3b432/payload-processing/0.log"
Sep 09 16:33:07.782959 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:07.782931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775cbbfd5d-w7f9r_a3c9e417-88aa-49fc-afaf-8c0988eaf278/router/0.log"
Sep 09 16:33:09.425114 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:09.425078    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dd6l7_b19b88eb-885f-45bc-a0f1-8d1c983026b8/discovery/0.log"
Sep 09 16:33:09.441372 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:09.441320    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747b697884-hfp2m_00541c1b-2d78-4f15-9ec8-f7ea6d9d8d82/kube-auth-proxy/0.log"
Sep 09 16:33:09.560458 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:09.560425    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pw6qh_816139fc-4aa6-4afe-9ad4-37008de3b432/payload-processing/0.log"
Sep 09 16:33:09.577204 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:09.577177    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-775cbbfd5d-w7f9r_a3c9e417-88aa-49fc-afaf-8c0988eaf278/router/0.log"
Sep 09 16:33:10.536885 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:10.536860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g6q5c/perf-node-gather-daemonset-xqbjr"
Sep 09 16:33:11.864386 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:11.864339    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8cmnz_9e3d132d-dc7f-42ee-ae8c-88eab997c87b/kube-storage-version-migrator-operator/1.log"
Sep 09 16:33:11.865216 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:11.865198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8cmnz_9e3d132d-dc7f-42ee-ae8c-88eab997c87b/kube-storage-version-migrator-operator/0.log"
Sep 09 16:33:13.080453 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.080373    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6bfn7_754d6c4d-250a-4767-8ee4-b798b06136cd/kube-multus/0.log"
Sep 09 16:33:13.280892 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.280861    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/kube-multus-additional-cni-plugins/0.log"
Sep 09 16:33:13.302059 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.302031    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/egress-router-binary-copy/0.log"
Sep 09 16:33:13.322695 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.322674    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/cni-plugins/0.log"
Sep 09 16:33:13.343688 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.343623    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/bond-cni-plugin/0.log"
Sep 09 16:33:13.363582 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.363556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/routeoverride-cni/0.log"
Sep 09 16:33:13.387551 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.387453    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/whereabouts-cni-bincopy/0.log"
Sep 09 16:33:13.407186 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.407164    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbq48_dcc07e59-b7a3-4108-976e-9491c3635849/whereabouts-cni/0.log"
Sep 09 16:33:13.722833 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.722806    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9l5kb_7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b/network-metrics-daemon/0.log"
Sep 09 16:33:13.744107 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:13.744079    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9l5kb_7a939a9b-7a18-4dcc-a8a1-b21eeb99ae1b/kube-rbac-proxy/0.log"
Sep 09 16:33:14.688265 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.688186    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/ovn-controller/0.log"
Sep 09 16:33:14.703471 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.703451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/ovn-acl-logging/0.log"
Sep 09 16:33:14.727777 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.727758    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/kube-rbac-proxy-node/0.log"
Sep 09 16:33:14.747684 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.747669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 16:33:14.763921 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.763907    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/northd/0.log"
Sep 09 16:33:14.786699 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.786680    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/nbdb/0.log"
Sep 09 16:33:14.809498 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.809472    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/sbdb/0.log"
Sep 09 16:33:14.860236 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:14.860217    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lsq7_c4c7ef73-5324-4b39-885b-aa24eeeee504/ovnkube-controller/0.log"
Sep 09 16:33:16.438822 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:16.438798    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tr7n8_bf9dd93a-f8c7-4520-ae55-99fdc6a6d0d8/network-check-target-container/0.log"
Sep 09 16:33:17.568167 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:17.568138    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cq2th_2aef2f60-c07a-48f5-851b-41c7b7f27347/iptables-alerter/0.log"
Sep 09 16:33:18.275409 ip-10-0-135-66 kubenswrapper[2578]: I0909 16:33:18.275378    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dr4kf_39615f21-f5f0-4e98-8183-9e9d129497df/tuned/0.log"