Sep 20 00:47:22.297198 ip-10-0-141-21 systemd[1]: Starting Kubernetes Kubelet...
Sep 20 00:47:25.835535 ip-10-0-141-21 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:25.835535 ip-10-0-141-21 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 20 00:47:25.835535 ip-10-0-141-21 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:25.835535 ip-10-0-141-21 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 20 00:47:25.835535 ip-10-0-141-21 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:25.836424 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.835655    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 20 00:47:25.838628 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838604    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:25.838628 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838623    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:25.838628 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838630    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:25.838628 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838634    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838639    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838644    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838647    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838652    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838657    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838660    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838664    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838668    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838671    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838675    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838679    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838683    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838687    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838690    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838694    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838698    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838701    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838705    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838709    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:25.838887 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838713    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838717    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838721    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838725    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838733    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838738    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838742    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838746    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838749    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838754    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838758    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838762    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838774    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838779    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838784    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838789    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838793    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838797    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838801    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:25.839739 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838805    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838810    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838814    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838818    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838822    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838826    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838831    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838835    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838839    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838843    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838848    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838852    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838856    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838860    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838865    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838869    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838874    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838878    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838884    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838891    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:25.840568 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838896    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838902    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838906    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838910    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838931    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838936    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838939    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838945    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838950    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838954    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838958    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838967    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838973    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838978    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838983    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838988    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838993    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.838997    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839002    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:25.841427 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839006    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839010    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839014    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839018    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839022    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839027    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839031    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839035    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839040    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839044    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839052    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839056    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839061    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839067    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839072    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839077    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839082    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.839086    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840255    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840266    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:25.842259 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840272    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840277    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840289    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840294    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840298    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840302    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840307    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840311    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840315    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840321    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840326    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840333    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840340    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840345    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840349    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840353    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840359    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840363    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840367    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:25.843172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840371    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840376    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840381    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840385    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840389    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840393    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840397    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840401    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840406    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840410    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840414    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840418    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840422    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840426    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840432    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840436    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840440    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840444    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840448    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840452    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:25.843856 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840456    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840460    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840467    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840474    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840479    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840483    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840487    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840491    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840495    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840500    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840504    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840508    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840512    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840516    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840521    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840525    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840530    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840534    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840538    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:25.844412 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840543    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840548    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840552    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840558    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840565    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840569    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840573    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840577    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840581    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840585    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840589    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840593    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840598    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840602    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840605    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840610    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840615    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840620    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840624    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:25.845077 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840628    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840632    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840636    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840640    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840644    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840648    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840652    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840656    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840661    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840665    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840670    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840674    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840678    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840682    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840686    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840690    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840694    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840699    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840703    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.840708    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:25.845603 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841410    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841420    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841425    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841430    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841434    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841438    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841442    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841446    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841450    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841454    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841459    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841465    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841470    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841475    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841479    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841484    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841488    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841492    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841496    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841500    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:25.846172 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841504    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841509    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841513    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841517    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841521    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841525    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841529    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841533    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841537    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841542    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841546    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841553    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841558    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841562    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841566    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841570    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841574    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841578    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841582    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841585    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:25.846692 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841590    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841594    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841598    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841605    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841611    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841618    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841624    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841629    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841633    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841638    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841642    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841646    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841650    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841654    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841658    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841663    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841667    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841671    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841675    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:25.847200 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841679    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841684    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841688    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841694    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841699    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841703    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841707    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841712    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841716    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841720    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841725    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841729    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841733    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841737    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841743    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841749    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841754    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841760    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841767    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:25.847664 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841772    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841776    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841780    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841784    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841788    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841792    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841797    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841801    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841805    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841809    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841813    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841818    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841822    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841826    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841830    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841834    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841838    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841844    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841849    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841852    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:25.848141 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.841857    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.841971    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842030    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842041    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842048    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842055    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842060    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842066    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842073    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842079    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842084    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842091    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842097    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842102    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842107    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842112    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842117    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842121    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842126    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842132    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842137    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842142    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842147    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842153    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 20 00:47:25.848679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842159    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842164    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842169    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842174    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842179    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842186    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842191    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842196    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842201    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842207    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842212    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842216    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842221    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842226    2568 flags.go:64] FLAG: --enable-server="true"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842230    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842239    2568 flags.go:64] FLAG: --event-burst="100"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842244    2568 flags.go:64] FLAG: --event-qps="50"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842249    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842254    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842258    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842265    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842270    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842275    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842280    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842284    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 20 00:47:25.849361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842290    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842294    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842300    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842304    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842309    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842314    2568 flags.go:64] FLAG: --feature-gates=""
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842320    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842325    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842330    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842335    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842340    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842345    2568 flags.go:64] FLAG: --help="false"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842353    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-141-21.ec2.internal"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842358    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842363    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842368    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842373    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842379    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842384    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842388    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842393    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842398    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842402    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842407    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 20 00:47:25.850056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842412    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842417    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842422    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842427    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842432    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842437    2568 flags.go:64] FLAG: --lock-file=""
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842442    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842446    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842450    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842459    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842464    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842469    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842474    2568 flags.go:64] FLAG: --logging-format="text"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842478    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842484    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842488    2568 flags.go:64] FLAG: --manifest-url=""
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842493    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842500    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842505    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842512    2568 flags.go:64] FLAG: --max-pods="110"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842518    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842523    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842527    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842532    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842537    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 20 00:47:25.850657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842543    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842549    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842561    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842566    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842571    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842576    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842581    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842591    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842597    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842602    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842607    2568 flags.go:64] FLAG: --port="10250"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842612    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842621    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01864fdfab06dde1a"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842627    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842633    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842638    2568 flags.go:64] FLAG: --register-node="true"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842643    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842649    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842665    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842670    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842675    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842681    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842686    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842691    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842696    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 20 00:47:25.851280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842700    2568 flags.go:64] FLAG: --runonce="false"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842705    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842711    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842717    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842722    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842727    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842732    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842737    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842741    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842746    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842751    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842756    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842760    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842765    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842772    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842776    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842785    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842790    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842795    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842801    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842807    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842811    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842816    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842821    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842826    2568 flags.go:64] FLAG: --v="2"
Sep 20 00:47:25.851952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842832    2568 flags.go:64] FLAG: --version="false"
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842838    2568 flags.go:64] FLAG: --vmodule=""
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842844    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.842850    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843047    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843056    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843061    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843066    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843071    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843075    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843081    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843085    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843090    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843095    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843099    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843103    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843107    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843111    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843115    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843120    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:25.852573 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843124    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843130    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843134    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843138    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843143    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843147    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843151    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843155    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843161    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843167    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843173    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843178    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843183    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843188    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843193    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843198    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843202    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843206    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843210    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:25.853085 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843215    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843219    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843223    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843229    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843233    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843237    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843241    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843245    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843251    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843258    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843262    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843266    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843270    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843275    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843280    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843284    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843288    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843292    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843297    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:25.853551 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843301    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843305    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843309    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843314    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843318    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843323    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843328    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843332    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843336    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843340    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843344    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843349    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843353    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843358    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843362    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843366    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843372    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843376    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843381    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843385    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:25.854084 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843389    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843393    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843398    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843402    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843405    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843410    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843414    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843420    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843424    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843428    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843433    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843437    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843441    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843446    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843450    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843454    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843459    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843463    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843467    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843471    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:25.854620 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843475    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843479    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843483    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843488    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.843491    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.843500    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.850985    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.851000    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.851020    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.851030    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851106    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851111    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851115    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851119    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851122    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:25.855122 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851125    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851128    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851133    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851139    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851143    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851148    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851153    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851157    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851161    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851165    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851168    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851170    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851173    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851184    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851187    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851190    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851193    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851195    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851198    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:25.855638 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851201    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851203    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851206    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851209    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851212    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851216    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851220    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851224    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851228    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851232    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851235    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851238    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851241    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851243    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851246    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851248    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851252    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851256    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851258    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851261    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:25.856452 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851268    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851271    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851273    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851276    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851279    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851282    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851284    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851293    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851297    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851302    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851306    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851310    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851314    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851317    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851320    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851323    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851325    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851329    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851331    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:25.857051 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851334    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851337    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851339    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851342    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851344    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851347    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851350    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851352    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851355    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851357    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851360    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851363    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851365    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851368    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851371    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851373    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851377    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851382    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851386    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851390    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:25.857648 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851393    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851402    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851405    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851408    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851411    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851413    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851416    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851418    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851421    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851424    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851427    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851430    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851433    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851435    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851438    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:25.858205 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851440    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.851446    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851613    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851620    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851625    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851629    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851634    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851638    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851641    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851644    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851647    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851650    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851653    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851656    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:25.858571 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851658    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851661    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851663    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851666    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851669    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851679    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851682    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851685    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851687    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851690    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851692    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851695    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851698    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851701    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851706    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851712    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851718    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851721    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851724    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:25.859068 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851727    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851730    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851733    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851735    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851738    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851741    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851743    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851746    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851749    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851752    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851754    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851757    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851760    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851762    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851765    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851768    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851772    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851775    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851778    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851788    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:25.859804 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851792    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851796    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851800    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851803    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851806    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851808    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851811    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851814    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851816    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851819    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851828    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851831    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851833    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851836    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851838    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851841    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851843    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851846    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851848    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851851    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:25.860513 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851853    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851856    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851858    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851861    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851864    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851868    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851874    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851880    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851884    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851887    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851890    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851893    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851902    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851905    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851908    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851911    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851928    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851931    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851933    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:25.861082 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851936    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851939    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851941    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851945    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851950    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851954    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851958    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851963    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:25.851966    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.851971    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.852095    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.854192    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.855266    2568 server.go:1019] "Starting client certificate rotation"
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.855413    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 00:47:25.861552 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.855461    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 00:47:25.861902 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.857733    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 00:47:25.862262 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.862239    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 00:47:25.866668 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.866650    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 20 00:47:25.870135 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.870120    2568 log.go:25] "Validated CRI v1 image API"
Sep 20 00:47:25.870978 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.870952    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 20 00:47:25.873963 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.873944    2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9c0f6958-4686-4e43-bcde-5779671a40bd:/dev/nvme0n1p4 b45f601d-72cd-49bf-a5f2-d008c4fff467:/dev/nvme0n1p3]
Sep 20 00:47:25.874025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.873964    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 20 00:47:25.878320 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.878206    2568 manager.go:216] Machine: {Timestamp:2026-09-20 00:47:25.877700634 +0000 UTC m=+2.127202432 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106655 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27510e52dad749ec59a3621c1113e4 SystemUUID:ec27510e-52da-d749-ec59-a3621c1113e4 BootID:25ff77b6-cd37-42b4-b1ee-456928e2be04 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e8:16:3f:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e8:16:3f:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:3a:b2:d1:14:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 20 00:47:25.878320 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.878309    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 20 00:47:25.878459 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.878389    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 20 00:47:25.879907 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.879885    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 20 00:47:25.880056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.879909    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 20 00:47:25.881040 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.881029    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 20 00:47:25.881073 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.881043    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 20 00:47:25.881073 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.881056    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 00:47:25.881073 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.881068    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 00:47:25.881193 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.881141    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 20 00:47:25.884994 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.884979    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 00:47:25.885117 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885106    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 20 00:47:25.885169 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885132    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 20 00:47:25.885169 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885143    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 20 00:47:25.885169 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885155    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 20 00:47:25.885169 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885168    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 20 00:47:25.885346 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885184    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 20 00:47:25.885671 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885658    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 00:47:25.885714 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.885682    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 00:47:25.889037 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.889018    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 00:47:25.892893 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.892876    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 20 00:47:25.895976 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.895952    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 20 00:47:25.896066 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.896001    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 20 00:47:25.898197 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898180    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898201    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898208    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898213    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898223    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898229    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898243    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898248    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898256    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898262    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898270    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 20 00:47:25.898272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898277    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 20 00:47:25.898555 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898302    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 20 00:47:25.898555 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.898308    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 20 00:47:25.899576 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.899554    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 20 00:47:25.904455 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.899547    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 20 00:47:25.907089 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.907078    2568 server.go:1268] "Started kubelet"
Sep 20 00:47:25.907159 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.907133    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 20 00:47:25.907239 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.907191    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 20 00:47:25.907275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.907265    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 20 00:47:25.908154 ip-10-0-141-21 systemd[1]: Started Kubernetes Kubelet.
Sep 20 00:47:25.908665 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.908452    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 20 00:47:25.911132 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.911109    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 20 00:47:25.913986 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.913969    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 20 00:47:25.915610 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.915595    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 20 00:47:25.915886 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.915873    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 20 00:47:25.915950 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.915887    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 20 00:47:25.916010 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.915963    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:25.916457 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.916437    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 20 00:47:25.916537 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.916460    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 20 00:47:25.916537 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.916443    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 20 00:47:25.916739 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.916717    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 20 00:47:25.916739 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.916729    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 20 00:47:25.917014 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.916987    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 20 00:47:25.917014 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917006    2568 factory.go:55] Registering systemd factory
Sep 20 00:47:25.917014 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917015    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 20 00:47:25.917251 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917229    2568 factory.go:153] Registering CRI-O factory
Sep 20 00:47:25.917251 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917249    2568 factory.go:223] Registration of the crio container factory successfully
Sep 20 00:47:25.917381 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917266    2568 factory.go:103] Registering Raw factory
Sep 20 00:47:25.917381 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917280    2568 manager.go:1196] Started watching for new ooms in manager
Sep 20 00:47:25.917681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.917669    2568 manager.go:349] Starting recovery of all containers
Sep 20 00:47:25.927808 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.927660    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 20 00:47:25.927808 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.927679    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 20 00:47:25.937718 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.937697    2568 manager.go:354] Recovery completed
Sep 20 00:47:25.938268 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.938081    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbln9"
Sep 20 00:47:25.943249 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.943233    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:25.944487 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.944472    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbln9"
Sep 20 00:47:25.944980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.944967    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:25.945037 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.944993    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:25.945037 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.945008    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:25.945532 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.945516    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 20 00:47:25.945532 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.945528    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:25.945631 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.945531    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 20 00:47:25.945631 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.945620    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 00:47:25.946244 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.946227    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:25.946320 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.946255    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:25.946320 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.946265    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:25.947796 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.947783    2568 policy_none.go:49] "None policy: Start"
Sep 20 00:47:25.947844 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.947800    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 20 00:47:25.947844 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.947809    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 20 00:47:25.949745 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.949732    2568 policy_none.go:47] "Start"
Sep 20 00:47:25.950972 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.950122    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-21.ec2.internal.18d6e0f5421b69a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-21.ec2.internal,UID:ip-10-0-141-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-21.ec2.internal,},FirstTimestamp:2026-09-20 00:47:25.907052968 +0000 UTC m=+2.156554763,LastTimestamp:2026-09-20 00:47:25.907052968 +0000 UTC m=+2.156554763,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-21.ec2.internal,}"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.979245    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.980422    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.980464    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.980483    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.980522    2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.983224    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984479    2568 manager.go:337] "Starting Device Plugin manager"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.984512    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984526    2568 server.go:87] "Starting device plugin registration server"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984777    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984800    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984863    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984969    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:25.984996    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.985809    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 20 00:47:25.995368 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:25.985857    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.081467 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.081420    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"]
Sep 20 00:47:26.081656 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.081509    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:26.083521 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.083505    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:26.083623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.083541    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:26.083623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.083555    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:26.085682 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.085637    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:26.085756 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.085706    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:26.085832 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.085819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.085955 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.085852    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:26.086482 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086466    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:26.086482 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086478    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086496    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086501    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086509    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086513    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086534    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086480    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:26.086599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086588    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:26.086878 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.086605    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:26.088786 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.088769    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.088849 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.088801    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:26.089476 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.089459    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:26.089554 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.089483    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:26.089554 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.089496    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:26.095199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.095183    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.095275 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.095204    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-21.ec2.internal\": node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.118317 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.118298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83f61edfbbe363174121d395d98c65b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal\" (UID: \"e83f61edfbbe363174121d395d98c65b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.118417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.118322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/458cc5e4d409fd46cbba485eb0da8653-config\") pod \"kube-apiserver-proxy-ip-10-0-141-21.ec2.internal\" (UID: \"458cc5e4d409fd46cbba485eb0da8653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.118417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.118339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e83f61edfbbe363174121d395d98c65b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal\" (UID: \"e83f61edfbbe363174121d395d98c65b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.119723 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.119706    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-21.ec2.internal\" not found" node="ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.120159 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.120145    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.124122 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.124107    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-21.ec2.internal\" not found" node="ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.219082 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.219052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83f61edfbbe363174121d395d98c65b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal\" (UID: \"e83f61edfbbe363174121d395d98c65b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.219082 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.219083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/458cc5e4d409fd46cbba485eb0da8653-config\") pod \"kube-apiserver-proxy-ip-10-0-141-21.ec2.internal\" (UID: \"458cc5e4d409fd46cbba485eb0da8653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.219304 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.219100    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e83f61edfbbe363174121d395d98c65b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal\" (UID: \"e83f61edfbbe363174121d395d98c65b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.219304 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.219137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e83f61edfbbe363174121d395d98c65b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal\" (UID: \"e83f61edfbbe363174121d395d98c65b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.219304 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.219167    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/458cc5e4d409fd46cbba485eb0da8653-config\") pod \"kube-apiserver-proxy-ip-10-0-141-21.ec2.internal\" (UID: \"458cc5e4d409fd46cbba485eb0da8653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.219304 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.219161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83f61edfbbe363174121d395d98c65b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal\" (UID: \"e83f61edfbbe363174121d395d98c65b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.221160 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.221143    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.321763 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.321732    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.422637 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.422566    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.422637 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.422588    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.427950 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.427755    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:26.522967 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.522928    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.623470 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.623431    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.723976 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.723890    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.824442 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.824410    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.854528 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.854503    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 20 00:47:26.855076 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.854642    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 20 00:47:26.922500 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.922476    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:26.924945 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:26.924495    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:26.949892 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.949850    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-19 00:42:25 +0000 UTC" deadline="2028-02-22 02:51:32.587367159 +0000 UTC"
Sep 20 00:47:26.949892 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:26.949888    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12482h4m5.637481908s"
Sep 20 00:47:27.025614 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:27.025592    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-21.ec2.internal\" not found"
Sep 20 00:47:27.059354 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:27.059317    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458cc5e4d409fd46cbba485eb0da8653.slice/crio-77911976f7c342ae8d82d83eaa6625bf0c6871474c0353effd6af8fe165c98ad WatchSource:0}: Error finding container 77911976f7c342ae8d82d83eaa6625bf0c6871474c0353effd6af8fe165c98ad: Status 404 returned error can't find the container with id 77911976f7c342ae8d82d83eaa6625bf0c6871474c0353effd6af8fe165c98ad
Sep 20 00:47:27.059562 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:27.059541    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83f61edfbbe363174121d395d98c65b.slice/crio-c3f7090ef2e3fb3969e1585f8fed2e61198111624c72ea5d74c7c90ca6ea63f9 WatchSource:0}: Error finding container c3f7090ef2e3fb3969e1585f8fed2e61198111624c72ea5d74c7c90ca6ea63f9: Status 404 returned error can't find the container with id c3f7090ef2e3fb3969e1585f8fed2e61198111624c72ea5d74c7c90ca6ea63f9
Sep 20 00:47:27.062317 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.062294    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:27.065420 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.065405    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:47:27.116095 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.116071    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:27.126425 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.126403    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 00:47:27.128485 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.128469    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal"
Sep 20 00:47:27.139354 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.139337    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 00:47:27.141882 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.141868    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:27.886205 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.886162    2568 apiserver.go:52] "Watching apiserver"
Sep 20 00:47:27.887077 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.887057    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:27.891844 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.891817    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 20 00:47:27.892312 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.892280    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mkbhg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r","openshift-cluster-node-tuning-operator/tuned-vxc8n","openshift-dns/node-resolver-ssbd8","openshift-image-registry/node-ca-rxsh4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal","openshift-network-diagnostics/network-check-target-zfszg","kube-system/global-pull-secret-syncer-n742d","kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal","openshift-multus/multus-94cqs","openshift-multus/multus-additional-cni-plugins-lq5zs","openshift-multus/network-metrics-daemon-nph9k","openshift-network-operator/iptables-alerter-8bx6r","openshift-ovn-kubernetes/ovnkube-node-zzzzj"]
Sep 20 00:47:27.894796 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.894775    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:27.894895 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:27.894856    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:27.897023 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.897003    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:27.899533 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.899514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.900732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.900564    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.900732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.900580    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 20 00:47:27.900732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.900595    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.900732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.900621    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r7q4k\""
Sep 20 00:47:27.901597 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.901471    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.901597 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.901483    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.901597 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.901529    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pcz79\""
Sep 20 00:47:27.902461 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.902345    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:27.904385 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.904030    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkstd\""
Sep 20 00:47:27.904385 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.904223    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.904385 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.904275    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.904645 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.904624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:27.906524 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.906379    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.906524 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.906431    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 20 00:47:27.906642 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.906602    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg88r\""
Sep 20 00:47:27.906802 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.906785    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.906897 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.906878    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.909040 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.908868    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 20 00:47:27.909040 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.908889    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xgpnh\""
Sep 20 00:47:27.909202 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.909045    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.909275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.909256    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:27.909354 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:27.909332    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:27.909939 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.909898    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.910132 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.910110    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 20 00:47:27.910286 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.910214    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 20 00:47:27.910366 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.910301    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 20 00:47:27.912315 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.912271    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:27.914152 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.914131    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 20 00:47:27.914580 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.914561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9vp5\""
Sep 20 00:47:27.914825 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.914807    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 20 00:47:27.915956 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.915936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.916890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.916871    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 20 00:47:27.917821 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.917803    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 20 00:47:27.918069 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.918020    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.918130 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.918099    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dcxwc\""
Sep 20 00:47:27.918355 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.918337    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.919479 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.919463    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.922038 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.921518    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:27.922038 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.921529    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g87nl\""
Sep 20 00:47:27.922038 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.921550    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 20 00:47:27.922038 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.921772    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 20 00:47:27.922038 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.921787    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 20 00:47:27.922314 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.922195    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 20 00:47:27.923793 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.923775    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:27.923863 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:27.923842    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:27.924026 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.924011    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 20 00:47:27.924099 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.924065    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 20 00:47:27.924535 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.924506    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-78xwx\""
Sep 20 00:47:27.928526 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5842520d-6796-4145-b3d2-ccc7bd40ea0e-tmp-dir\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:27.928669 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-ovnkube-script-lib\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.928743 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca261dfa-0300-498b-9f0e-f21d394d8ee6-kubelet-config\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:27.928743 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:27.928856 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-netns\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.928856 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-hostroot\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.928856 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-conf-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chxlz\" (UniqueName: \"kubernetes.io/projected/56a54547-1b88-4d84-8ddb-66cb7ed4a661-kube-api-access-chxlz\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-serviceca\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:27.929025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-systemd-units\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928968    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-ovn\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.928990    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-socket-dir-parent\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929015    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-multus-certs\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-var-lib-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-kubelet\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-socket-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929111    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-k8s-cni-cncf-io\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-cni-bin\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5842520d-6796-4145-b3d2-ccc7bd40ea0e-hosts-file\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929190    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-kube-api-access-rxnls\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-etc-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929226    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd-konnectivity-ca\") pod \"konnectivity-agent-mkbhg\" (UID: \"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd\") " pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929261    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-system-cni-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929305 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929285    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-cni-multus\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929326    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-sys\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929342    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg6v5\" (UniqueName: \"kubernetes.io/projected/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-kube-api-access-gg6v5\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-cni-bin\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-sys-fs\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-modprobe-d\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-kubernetes\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-lib-modules\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929523    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-registration-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929533    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3c1f85c-1208-4641-83df-379c226d0c74-cni-binary-copy\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56a54547-1b88-4d84-8ddb-66cb7ed4a661-tmp\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-kubelet\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-cni-netd\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca261dfa-0300-498b-9f0e-f21d394d8ee6-dbus\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysctl-conf\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.929848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-node-log\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929795    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-env-overrides\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-device-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-systemd\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-run\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-tuned\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929949    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-iptables-alerter-script\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.929979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-run-netns\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-host-slash\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-systemd\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd-agent-certs\") pod \"konnectivity-agent-mkbhg\" (UID: \"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd\") " pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-var-lib-kubelet\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-host\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqwb\" (UniqueName: \"kubernetes.io/projected/927586c6-0af0-43c3-821c-61140206edaa-kube-api-access-5fqwb\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-etc-kubernetes\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.930680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930342    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbsb\" (UniqueName: \"kubernetes.io/projected/3aeee648-94b7-4808-9dda-aaaf9d728251-kube-api-access-stbsb\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysctl-d\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-host\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgh4p\" (UniqueName: \"kubernetes.io/projected/5842520d-6796-4145-b3d2-ccc7bd40ea0e-kube-api-access-qgh4p\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930472    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-ovnkube-config\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aeee648-94b7-4808-9dda-aaaf9d728251-ovn-node-metrics-cert\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-cnibin\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930591    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-slash\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930619    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-log-socket\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-cni-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3c1f85c-1208-4641-83df-379c226d0c74-multus-daemon-config\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x9qn\" (UniqueName: \"kubernetes.io/projected/b3c1f85c-1208-4641-83df-379c226d0c74-kube-api-access-9x9qn\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:27.931391 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.930746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysconfig\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:27.945843 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.945820    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvdng"
Sep 20 00:47:27.955435 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.955416    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvdng"
Sep 20 00:47:27.988390 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.988333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal" event={"ID":"e83f61edfbbe363174121d395d98c65b","Type":"ContainerStarted","Data":"c3f7090ef2e3fb3969e1585f8fed2e61198111624c72ea5d74c7c90ca6ea63f9"}
Sep 20 00:47:27.989592 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:27.989569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal" event={"ID":"458cc5e4d409fd46cbba485eb0da8653","Type":"ContainerStarted","Data":"77911976f7c342ae8d82d83eaa6625bf0c6871474c0353effd6af8fe165c98ad"}
Sep 20 00:47:28.017729 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.017694    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 20 00:47:28.031662 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031625    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-host-slash\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-systemd\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd-agent-certs\") pod \"konnectivity-agent-mkbhg\" (UID: \"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd\") " pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-var-lib-kubelet\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-host-slash\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-host\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqwb\" (UniqueName: \"kubernetes.io/projected/927586c6-0af0-43c3-821c-61140206edaa-kube-api-access-5fqwb\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-systemd\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-etc-kubernetes\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.031850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031861    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-host\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbsb\" (UniqueName: \"kubernetes.io/projected/3aeee648-94b7-4808-9dda-aaaf9d728251-kube-api-access-stbsb\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysctl-d\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-etc-kubernetes\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-var-lib-kubelet\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031911    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-host\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.031993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgh4p\" (UniqueName: \"kubernetes.io/projected/5842520d-6796-4145-b3d2-ccc7bd40ea0e-kube-api-access-qgh4p\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-ovnkube-config\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aeee648-94b7-4808-9dda-aaaf9d728251-ovn-node-metrics-cert\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-cnibin\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-slash\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032147    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 20 00:47:28.032342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-log-socket\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-cni-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032220    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-host\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3c1f85c-1208-4641-83df-379c226d0c74-multus-daemon-config\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysctl-d\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x9qn\" (UniqueName: \"kubernetes.io/projected/b3c1f85c-1208-4641-83df-379c226d0c74-kube-api-access-9x9qn\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysconfig\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032364    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5842520d-6796-4145-b3d2-ccc7bd40ea0e-tmp-dir\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-ovnkube-script-lib\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca261dfa-0300-498b-9f0e-f21d394d8ee6-kubelet-config\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-netns\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-hostroot\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-conf-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chxlz\" (UniqueName: \"kubernetes.io/projected/56a54547-1b88-4d84-8ddb-66cb7ed4a661-kube-api-access-chxlz\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-serviceca\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.033147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032590    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-systemd-units\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-ovn\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-socket-dir-parent\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-multus-certs\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-var-lib-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-kubelet\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-system-cni-dir\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-socket-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-k8s-cni-cncf-io\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-cni-bin\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032820    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3c1f85c-1208-4641-83df-379c226d0c74-multus-daemon-config\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5842520d-6796-4145-b3d2-ccc7bd40ea0e-hosts-file\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-kube-api-access-rxnls\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-etc-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032911    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-slash\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.033901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.032955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd-konnectivity-ca\") pod \"konnectivity-agent-mkbhg\" (UID: \"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd\") " pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-system-cni-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-cni-multus\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-sys\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg6v5\" (UniqueName: \"kubernetes.io/projected/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-kube-api-access-gg6v5\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-cni-bin\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-ovnkube-config\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-sys-fs\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-cnibin\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033276    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-log-socket\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033316    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-cni-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033435    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-system-cni-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd-konnectivity-ca\") pod \"konnectivity-agent-mkbhg\" (UID: \"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd\") " pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033477    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-ovn\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-socket-dir-parent\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.034732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033624    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-multus-certs\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-var-lib-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.033665    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033682    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-netns\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033685    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-kubelet\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.033730    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:28.533710701 +0000 UTC m=+4.783212501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033734    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-hostroot\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033778    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysconfig\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-socket-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-run-k8s-cni-cncf-io\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033845    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-multus-conf-dir\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-cni-bin\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033962    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5842520d-6796-4145-b3d2-ccc7bd40ea0e-hosts-file\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5842520d-6796-4145-b3d2-ccc7bd40ea0e-tmp-dir\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-etc-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-run-openvswitch\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-serviceca\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-systemd-units\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.035551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034482    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-sys\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-ovnkube-script-lib\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034542    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca261dfa-0300-498b-9f0e-f21d394d8ee6-kubelet-config\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-cni-bin\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.033176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-sys-fs\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-modprobe-d\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-kubernetes\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-lib-modules\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034653    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-cnibin\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-registration-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034685    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-modprobe-d\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-registration-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3c1f85c-1208-4641-83df-379c226d0c74-host-var-lib-cni-multus\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3c1f85c-1208-4641-83df-379c226d0c74-cni-binary-copy\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034777    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-kubernetes\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-lib-modules\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56a54547-1b88-4d84-8ddb-66cb7ed4a661-tmp\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.037402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2948z\" (UniqueName: \"kubernetes.io/projected/0dbb192c-cf1d-485b-8777-72ee430191fe-kube-api-access-2948z\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-kubelet\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-cni-netd\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bqb\" (UniqueName: \"kubernetes.io/projected/bafb2e84-f0f7-499d-a96f-8385327a0b63-kube-api-access-b8bqb\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca261dfa-0300-498b-9f0e-f21d394d8ee6-dbus\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.034992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysctl-conf\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-node-log\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-env-overrides\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-device-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-systemd\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-run\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-tuned\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-iptables-alerter-script\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-run-netns\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca261dfa-0300-498b-9f0e-f21d394d8ee6-dbus\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035207    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3c1f85c-1208-4641-83df-379c226d0c74-cni-binary-copy\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035254    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-node-log\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.038275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-systemd\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035291    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-device-dir\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035319    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-sysctl-conf\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56a54547-1b88-4d84-8ddb-66cb7ed4a661-run\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/927586c6-0af0-43c3-821c-61140206edaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035481    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-kubelet\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-cni-netd\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aeee648-94b7-4808-9dda-aaaf9d728251-env-overrides\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035703    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aeee648-94b7-4808-9dda-aaaf9d728251-host-run-netns\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.035992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-iptables-alerter-script\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.036589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd-agent-certs\") pod \"konnectivity-agent-mkbhg\" (UID: \"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd\") " pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.037928    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56a54547-1b88-4d84-8ddb-66cb7ed4a661-tmp\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.039081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.038230    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aeee648-94b7-4808-9dda-aaaf9d728251-ovn-node-metrics-cert\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.039650 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.039565    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56a54547-1b88-4d84-8ddb-66cb7ed4a661-etc-tuned\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.043378 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.043319    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbsb\" (UniqueName: \"kubernetes.io/projected/3aeee648-94b7-4808-9dda-aaaf9d728251-kube-api-access-stbsb\") pod \"ovnkube-node-zzzzj\" (UID: \"3aeee648-94b7-4808-9dda-aaaf9d728251\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.043701 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.043588    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:28.043701 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.043609    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:28.043701 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.043622    2568 projected.go:196] Error preparing data for projected volume kube-api-access-zj68q for pod openshift-network-diagnostics/network-check-target-zfszg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:28.043701 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.043678    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q podName:86f97874-4050-47d0-a0a7-aff13bac587f nodeName:}" failed. No retries permitted until 2026-09-20 00:47:28.543661276 +0000 UTC m=+4.793163064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zj68q" (UniqueName: "kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q") pod "network-check-target-zfszg" (UID: "86f97874-4050-47d0-a0a7-aff13bac587f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:28.046099 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.046028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgh4p\" (UniqueName: \"kubernetes.io/projected/5842520d-6796-4145-b3d2-ccc7bd40ea0e-kube-api-access-qgh4p\") pod \"node-resolver-ssbd8\" (UID: \"5842520d-6796-4145-b3d2-ccc7bd40ea0e\") " pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.046278 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.046256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqwb\" (UniqueName: \"kubernetes.io/projected/927586c6-0af0-43c3-821c-61140206edaa-kube-api-access-5fqwb\") pod \"aws-ebs-csi-driver-node-r596r\" (UID: \"927586c6-0af0-43c3-821c-61140206edaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.047892 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.047870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x9qn\" (UniqueName: \"kubernetes.io/projected/b3c1f85c-1208-4641-83df-379c226d0c74-kube-api-access-9x9qn\") pod \"multus-94cqs\" (UID: \"b3c1f85c-1208-4641-83df-379c226d0c74\") " pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.048050 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.048026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/caa30d1a-b31f-4f19-9b7e-ae21ab457b0e-kube-api-access-rxnls\") pod \"node-ca-rxsh4\" (UID: \"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e\") " pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.048277 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.048259    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg6v5\" (UniqueName: \"kubernetes.io/projected/0bd6af89-013a-4cca-a36c-7bebd4a5f11b-kube-api-access-gg6v5\") pod \"iptables-alerter-8bx6r\" (UID: \"0bd6af89-013a-4cca-a36c-7bebd4a5f11b\") " pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.049384 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.049345    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chxlz\" (UniqueName: \"kubernetes.io/projected/56a54547-1b88-4d84-8ddb-66cb7ed4a661-kube-api-access-chxlz\") pod \"tuned-vxc8n\" (UID: \"56a54547-1b88-4d84-8ddb-66cb7ed4a661\") " pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.136483 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.136483 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-system-cni-dir\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136483 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-cnibin\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136529    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-system-cni-dir\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2948z\" (UniqueName: \"kubernetes.io/projected/0dbb192c-cf1d-485b-8777-72ee430191fe-kube-api-access-2948z\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.136566    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bqb\" (UniqueName: \"kubernetes.io/projected/bafb2e84-f0f7-499d-a96f-8385327a0b63-kube-api-access-b8bqb\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136628    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-cnibin\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.136641    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:28.636620666 +0000 UTC m=+4.886122450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:28.136759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.137214 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.136782    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb192c-cf1d-485b-8777-72ee430191fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.137214 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.137149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.137214 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.137180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.137344 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.137239    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.138260 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.138240    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbb192c-cf1d-485b-8777-72ee430191fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.147332 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.147305    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bqb\" (UniqueName: \"kubernetes.io/projected/bafb2e84-f0f7-499d-a96f-8385327a0b63-kube-api-access-b8bqb\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.149280 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.149253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2948z\" (UniqueName: \"kubernetes.io/projected/0dbb192c-cf1d-485b-8777-72ee430191fe-kube-api-access-2948z\") pod \"multus-additional-cni-plugins-lq5zs\" (UID: \"0dbb192c-cf1d-485b-8777-72ee430191fe\") " pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.211153 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.211114    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8bx6r"
Sep 20 00:47:28.222562 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.222538    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxc8n"
Sep 20 00:47:28.232240 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.232219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssbd8"
Sep 20 00:47:28.239978 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.239955    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rxsh4"
Sep 20 00:47:28.247647 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.247625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:28.254303 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.254280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:28.261850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.261829    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r"
Sep 20 00:47:28.269568 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.269543    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94cqs"
Sep 20 00:47:28.274331 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.274306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lq5zs"
Sep 20 00:47:28.540344 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.540237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.540526 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.540413    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:28.540526 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.540495    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:29.540472528 +0000 UTC m=+5.789974322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:28.640864 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.640827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:28.640864 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.640870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.641056 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.641007    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:28.641056 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.641021    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:28.641056 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.641040    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:28.641056 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.641053    2568 projected.go:196] Error preparing data for projected volume kube-api-access-zj68q for pod openshift-network-diagnostics/network-check-target-zfszg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:28.641247 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.641083    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:29.641064326 +0000 UTC m=+5.890566125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:28.641247 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.641106    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q podName:86f97874-4050-47d0-a0a7-aff13bac587f nodeName:}" failed. No retries permitted until 2026-09-20 00:47:29.641090351 +0000 UTC m=+5.890592148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj68q" (UniqueName: "kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q") pod "network-check-target-zfszg" (UID: "86f97874-4050-47d0-a0a7-aff13bac587f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:28.958904 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.958858    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 00:42:27 +0000 UTC" deadline="2028-02-21 15:08:29.12891903 +0000 UTC"
Sep 20 00:47:28.958904 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.958903    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12470h21m0.170019714s"
Sep 20 00:47:28.971707 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:28.971672    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5842520d_6796_4145_b3d2_ccc7bd40ea0e.slice/crio-740bcc3867d27d4ff63be27de6026fe872632b06bf76846de39ae7206a5c94fc WatchSource:0}: Error finding container 740bcc3867d27d4ff63be27de6026fe872632b06bf76846de39ae7206a5c94fc: Status 404 returned error can't find the container with id 740bcc3867d27d4ff63be27de6026fe872632b06bf76846de39ae7206a5c94fc
Sep 20 00:47:28.972532 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:28.972508    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a54547_1b88_4d84_8ddb_66cb7ed4a661.slice/crio-acec8841121f0d18de581059bb5b243f2e846dae72d241c30e32884251ec92fe WatchSource:0}: Error finding container acec8841121f0d18de581059bb5b243f2e846dae72d241c30e32884251ec92fe: Status 404 returned error can't find the container with id acec8841121f0d18de581059bb5b243f2e846dae72d241c30e32884251ec92fe
Sep 20 00:47:28.980899 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.980877    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:28.981020 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.981001    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:28.981072 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.981053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:28.981154 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:28.981138    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:28.991719 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.991694    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssbd8" event={"ID":"5842520d-6796-4145-b3d2-ccc7bd40ea0e","Type":"ContainerStarted","Data":"740bcc3867d27d4ff63be27de6026fe872632b06bf76846de39ae7206a5c94fc"}
Sep 20 00:47:28.992981 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:28.992874    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aeee648_94b7_4808_9dda_aaaf9d728251.slice/crio-ba6b03e5c82cecfe49145d02696b0f668308ebf20d3e6c4686b8408378ce6b90 WatchSource:0}: Error finding container ba6b03e5c82cecfe49145d02696b0f668308ebf20d3e6c4686b8408378ce6b90: Status 404 returned error can't find the container with id ba6b03e5c82cecfe49145d02696b0f668308ebf20d3e6c4686b8408378ce6b90
Sep 20 00:47:28.993281 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:28.993256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxc8n" event={"ID":"56a54547-1b88-4d84-8ddb-66cb7ed4a661","Type":"ContainerStarted","Data":"acec8841121f0d18de581059bb5b243f2e846dae72d241c30e32884251ec92fe"}
Sep 20 00:47:28.993364 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:28.993344    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd6af89_013a_4cca_a36c_7bebd4a5f11b.slice/crio-bca0fe6700c2cab7e5a6f1501487f42ee029a0e854203816ec4953acb0767bb4 WatchSource:0}: Error finding container bca0fe6700c2cab7e5a6f1501487f42ee029a0e854203816ec4953acb0767bb4: Status 404 returned error can't find the container with id bca0fe6700c2cab7e5a6f1501487f42ee029a0e854203816ec4953acb0767bb4
Sep 20 00:47:28.995379 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:28.994513    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa30d1a_b31f_4f19_9b7e_ae21ab457b0e.slice/crio-1829633640f814e643c4f1ee6329aa154e436f291d7dd78cea92a8002d78548a WatchSource:0}: Error finding container 1829633640f814e643c4f1ee6329aa154e436f291d7dd78cea92a8002d78548a: Status 404 returned error can't find the container with id 1829633640f814e643c4f1ee6329aa154e436f291d7dd78cea92a8002d78548a
Sep 20 00:47:28.995738 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:28.995691    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927586c6_0af0_43c3_821c_61140206edaa.slice/crio-3cf1747a84c16749cbfc9399f528195c561f69738cc243cc99c3a29446565bb2 WatchSource:0}: Error finding container 3cf1747a84c16749cbfc9399f528195c561f69738cc243cc99c3a29446565bb2: Status 404 returned error can't find the container with id 3cf1747a84c16749cbfc9399f528195c561f69738cc243cc99c3a29446565bb2
Sep 20 00:47:29.000703 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:29.000681    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbb192c_cf1d_485b_8777_72ee430191fe.slice/crio-2ba8ddaacdb346d5f6043c1b0d22a25c4db6acd9efc3fb3b4d0ee0f309ac57ed WatchSource:0}: Error finding container 2ba8ddaacdb346d5f6043c1b0d22a25c4db6acd9efc3fb3b4d0ee0f309ac57ed: Status 404 returned error can't find the container with id 2ba8ddaacdb346d5f6043c1b0d22a25c4db6acd9efc3fb3b4d0ee0f309ac57ed
Sep 20 00:47:29.001591 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:29.001558    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c1f85c_1208_4641_83df_379c226d0c74.slice/crio-77d0a9651bc287c7e835b70144c6c9d53d2751b32f947470ad033352afebe946 WatchSource:0}: Error finding container 77d0a9651bc287c7e835b70144c6c9d53d2751b32f947470ad033352afebe946: Status 404 returned error can't find the container with id 77d0a9651bc287c7e835b70144c6c9d53d2751b32f947470ad033352afebe946
Sep 20 00:47:29.002668 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:47:29.002642    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016f3c6f_c12c_402e_8e8d_cdbc5e33c8fd.slice/crio-9a162eac4755600d87be105bc153e200083f4a13cf75acf78242cbd60564de50 WatchSource:0}: Error finding container 9a162eac4755600d87be105bc153e200083f4a13cf75acf78242cbd60564de50: Status 404 returned error can't find the container with id 9a162eac4755600d87be105bc153e200083f4a13cf75acf78242cbd60564de50
Sep 20 00:47:29.549130 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:29.548216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:29.549130 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.548450    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:29.549130 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.548604    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:31.54858189 +0000 UTC m=+7.798083673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:29.649043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:29.648986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:29.649043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:29.649038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:29.649274 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.649182    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:29.649274 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.649241    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:31.649224427 +0000 UTC m=+7.898726218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:29.649676 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.649657    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:29.649749 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.649684    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:29.649749 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.649697    2568 projected.go:196] Error preparing data for projected volume kube-api-access-zj68q for pod openshift-network-diagnostics/network-check-target-zfszg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:29.649845 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.649750    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q podName:86f97874-4050-47d0-a0a7-aff13bac587f nodeName:}" failed. No retries permitted until 2026-09-20 00:47:31.649735743 +0000 UTC m=+7.899237531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj68q" (UniqueName: "kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q") pod "network-check-target-zfszg" (UID: "86f97874-4050-47d0-a0a7-aff13bac587f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:29.959275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:29.959178    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 00:42:27 +0000 UTC" deadline="2028-06-23 11:16:33.011836948 +0000 UTC"
Sep 20 00:47:29.959275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:29.959219    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15418h29m3.052622646s"
Sep 20 00:47:29.984587 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:29.984061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:29.984587 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:29.984193    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:30.024692 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.024654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal" event={"ID":"458cc5e4d409fd46cbba485eb0da8653","Type":"ContainerStarted","Data":"69986865291c1563beb483aa9b6cce20ca60a3f1e242a0a7bd85ddf3301b6f8f"}
Sep 20 00:47:30.037904 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.037279    2568 generic.go:356] "Generic (PLEG): container finished" podID="e83f61edfbbe363174121d395d98c65b" containerID="188a0f3c68d0b40a7896e0a7d7863d4ad3fd2b401d9018ddbe04c63b0150ecff" exitCode=0
Sep 20 00:47:30.037904 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.037363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal" event={"ID":"e83f61edfbbe363174121d395d98c65b","Type":"ContainerDied","Data":"188a0f3c68d0b40a7896e0a7d7863d4ad3fd2b401d9018ddbe04c63b0150ecff"}
Sep 20 00:47:30.048126 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.048094    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r" event={"ID":"927586c6-0af0-43c3-821c-61140206edaa","Type":"ContainerStarted","Data":"3cf1747a84c16749cbfc9399f528195c561f69738cc243cc99c3a29446565bb2"}
Sep 20 00:47:30.056837 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.056784    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-21.ec2.internal" podStartSLOduration=3.056763614 podStartE2EDuration="3.056763614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:30.042198299 +0000 UTC m=+6.291700105" watchObservedRunningTime="2026-09-20 00:47:30.056763614 +0000 UTC m=+6.306265419"
Sep 20 00:47:30.068117 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.068022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8bx6r" event={"ID":"0bd6af89-013a-4cca-a36c-7bebd4a5f11b","Type":"ContainerStarted","Data":"bca0fe6700c2cab7e5a6f1501487f42ee029a0e854203816ec4953acb0767bb4"}
Sep 20 00:47:30.078737 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.078704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"ba6b03e5c82cecfe49145d02696b0f668308ebf20d3e6c4686b8408378ce6b90"}
Sep 20 00:47:30.085191 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.085161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkbhg" event={"ID":"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd","Type":"ContainerStarted","Data":"9a162eac4755600d87be105bc153e200083f4a13cf75acf78242cbd60564de50"}
Sep 20 00:47:30.092634 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.092600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94cqs" event={"ID":"b3c1f85c-1208-4641-83df-379c226d0c74","Type":"ContainerStarted","Data":"77d0a9651bc287c7e835b70144c6c9d53d2751b32f947470ad033352afebe946"}
Sep 20 00:47:30.102613 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.102542    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerStarted","Data":"2ba8ddaacdb346d5f6043c1b0d22a25c4db6acd9efc3fb3b4d0ee0f309ac57ed"}
Sep 20 00:47:30.112014 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.111872    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rxsh4" event={"ID":"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e","Type":"ContainerStarted","Data":"1829633640f814e643c4f1ee6329aa154e436f291d7dd78cea92a8002d78548a"}
Sep 20 00:47:30.982183 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.981759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:30.982183 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:30.981892    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:30.982753 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:30.982288    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:30.982753 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:30.982396    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:31.134579 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:31.134498    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal" event={"ID":"e83f61edfbbe363174121d395d98c65b","Type":"ContainerStarted","Data":"0229808b6b6b47625cd4a27e70a1febb998a84b45cffee3ee2f454e07424e0a7"}
Sep 20 00:47:31.564963 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:31.564906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:31.565166 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.565102    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:31.565281 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.565191    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:35.565169473 +0000 UTC m=+11.814671259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:31.666330 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:31.666099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:31.666330 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:31.666155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:31.666330 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.666297    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:31.666610 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.666362    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:35.666343972 +0000 UTC m=+11.915845760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:31.666885 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.666866    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:31.666990 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.666896    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:31.666990 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.666910    2568 projected.go:196] Error preparing data for projected volume kube-api-access-zj68q for pod openshift-network-diagnostics/network-check-target-zfszg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:31.666990 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.666970    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q podName:86f97874-4050-47d0-a0a7-aff13bac587f nodeName:}" failed. No retries permitted until 2026-09-20 00:47:35.666955349 +0000 UTC m=+11.916457134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj68q" (UniqueName: "kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q") pod "network-check-target-zfszg" (UID: "86f97874-4050-47d0-a0a7-aff13bac587f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:31.983252 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:31.983176    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:31.983698 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:31.983303    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:32.981015 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:32.980981    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:32.981290 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:32.981110    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:32.981518 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:32.981497    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:32.981634 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:32.981613    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:33.981018 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:33.980987    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:33.981491 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:33.981125    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:34.981441 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:34.981407    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:34.982098 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:34.981544    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:34.982098 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:34.981583    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:34.982098 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:34.981653    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:35.600618 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:35.600579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:35.600790 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.600759    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:35.600877 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.600819    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:43.600800945 +0000 UTC m=+19.850302732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:35.701980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:35.701895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:35.701980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:35.701949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:35.702227 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.702120    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:35.702227 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.702148    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:35.702227 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.702161    2568 projected.go:196] Error preparing data for projected volume kube-api-access-zj68q for pod openshift-network-diagnostics/network-check-target-zfszg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:35.702227 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.702171    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:35.702227 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.702222    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q podName:86f97874-4050-47d0-a0a7-aff13bac587f nodeName:}" failed. No retries permitted until 2026-09-20 00:47:43.702203882 +0000 UTC m=+19.951705679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj68q" (UniqueName: "kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q") pod "network-check-target-zfszg" (UID: "86f97874-4050-47d0-a0a7-aff13bac587f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:35.702531 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.702303    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:43.702254257 +0000 UTC m=+19.951756058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:35.981823 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:35.981755    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:35.982299 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:35.981845    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:36.981167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:36.981130    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:36.981167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:36.981155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:36.981415 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:36.981270    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:36.981488 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:36.981416    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:37.981617 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:37.981585    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:37.982228 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:37.981693    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:38.981553 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:38.981521    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:38.981553 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:38.981553    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:38.982015 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:38.981624    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:38.982015 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:38.981751    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:39.981450 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:39.981413    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:39.981742 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:39.981541    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:40.980672 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:40.980642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:40.980854 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:40.980647    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:40.980854 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:40.980777    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:40.980854 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:40.980830    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:41.981350 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:41.981314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:41.981811 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:41.981451    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:42.981139 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:42.981108    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:42.981139 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:42.981140    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:42.981365 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:42.981223    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:42.981365 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:42.981342    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:43.659047 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:43.659011    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:43.659231 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.659131    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:43.659231 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.659196    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:59.659182105 +0000 UTC m=+35.908683892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:43.759781 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:43.759735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:43.759983 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:43.759795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:43.759983 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.759905    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:43.759983 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.759934    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:43.759983 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.759946    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:43.759983 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.759959    2568 projected.go:196] Error preparing data for projected volume kube-api-access-zj68q for pod openshift-network-diagnostics/network-check-target-zfszg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:43.760186 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.760000    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:59.759980337 +0000 UTC m=+36.009482128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:43.760186 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.760016    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q podName:86f97874-4050-47d0-a0a7-aff13bac587f nodeName:}" failed. No retries permitted until 2026-09-20 00:47:59.760009519 +0000 UTC m=+36.009511300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj68q" (UniqueName: "kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q") pod "network-check-target-zfszg" (UID: "86f97874-4050-47d0-a0a7-aff13bac587f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:43.981370 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:43.981325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:43.981836 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:43.981474    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:44.981507 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:44.981469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:44.981940 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:44.981486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:44.981940 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:44.981600    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:44.981940 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:44.981640    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:45.981607 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:45.981580    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:45.981985 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:45.981660    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:46.980855 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:46.980694    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:46.980971 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:46.980743    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:46.980971 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:46.980944    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:46.981084 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:46.981038    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:47.169636 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.169601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssbd8" event={"ID":"5842520d-6796-4145-b3d2-ccc7bd40ea0e","Type":"ContainerStarted","Data":"d29138f1df86dfa7494086e23e14d59d1e49bba4f9c49d52c7b5d6710406c898"}
Sep 20 00:47:47.171261 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.171235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r" event={"ID":"927586c6-0af0-43c3-821c-61140206edaa","Type":"ContainerStarted","Data":"601317fa2a8713ec3dbe24e42a0eb6b2480d13afe38bf041916bc227c25d432b"}
Sep 20 00:47:47.174441 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.174412    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"b77a102580730b8cc1e8f7f9fe2380184516b9b14c2821465a1f58d8bcaf5cdb"}
Sep 20 00:47:47.174556 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.174501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"24d6d9f123d86e7acf4fc698441ff5c9abe244ac2c2fec4bc554127fb0755e26"}
Sep 20 00:47:47.174621 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.174556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"7bb126e461e9f028180794eda1784b06c7b584b90bba1ef20835f132e234a79b"}
Sep 20 00:47:47.174621 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.174604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"3ad47d3eeb0344c2810bc8089a58516b548ca02d521e48e3c800f7d9bd32df8a"}
Sep 20 00:47:47.174747 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.174652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"244aadea2494f93eef97c0cd097a913aa995d66f265fe6eb42254ce4250e7949"}
Sep 20 00:47:47.174747 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.174699    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"6ba44fddccf3105b29ed712713f60578da6e9d01f01dba63f7d5d039901887c5"}
Sep 20 00:47:47.175819 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.175793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxc8n" event={"ID":"56a54547-1b88-4d84-8ddb-66cb7ed4a661","Type":"ContainerStarted","Data":"cb4efcd455330321a3ff3d03b175f3ad7041ec38a0301740ef933edd15c17eb0"}
Sep 20 00:47:47.177240 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.177220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkbhg" event={"ID":"016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd","Type":"ContainerStarted","Data":"970321111fc15c879e305e23babdd35c2ea6f6846b9fc5f22e8ae9f62553cf3f"}
Sep 20 00:47:47.178855 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.178829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94cqs" event={"ID":"b3c1f85c-1208-4641-83df-379c226d0c74","Type":"ContainerStarted","Data":"002a2a27d0d56ab899c26b9350ab3cca6252d575d454ef469ac577335d70ef92"}
Sep 20 00:47:47.180369 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.180345    2568 generic.go:356] "Generic (PLEG): container finished" podID="0dbb192c-cf1d-485b-8777-72ee430191fe" containerID="57174a15e53a22d20bde8e4d59750267032d2a07a957550807192464be55ceb2" exitCode=0
Sep 20 00:47:47.180469 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.180429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerDied","Data":"57174a15e53a22d20bde8e4d59750267032d2a07a957550807192464be55ceb2"}
Sep 20 00:47:47.181996 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.181946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rxsh4" event={"ID":"caa30d1a-b31f-4f19-9b7e-ae21ab457b0e","Type":"ContainerStarted","Data":"6435cdee50eb1fc9ec6f929c3e14239da0b2299034cc80e7d1c55360c7c6db4b"}
Sep 20 00:47:47.183999 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.183963    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ssbd8" podStartSLOduration=3.952921136 podStartE2EDuration="21.183951803s" totalImagesPullingTime="17.231030667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:47.183303664 +0000 UTC m=+23.432805480" watchObservedRunningTime="2026-09-20 00:47:47.183951803 +0000 UTC m=+23.433453606"
Sep 20 00:47:47.184120 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.184097    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-21.ec2.internal" podStartSLOduration=20.184089029 podStartE2EDuration="20.184089029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:31.149320261 +0000 UTC m=+7.398822064" watchObservedRunningTime="2026-09-20 00:47:47.184089029 +0000 UTC m=+23.433590833"
Sep 20 00:47:47.204083 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.204043    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-94cqs" podStartSLOduration=3.923111634 podStartE2EDuration="21.204026208s" totalImagesPullingTime="17.280914574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:47.203749021 +0000 UTC m=+23.453250836" watchObservedRunningTime="2026-09-20 00:47:47.204026208 +0000 UTC m=+23.453528013"
Sep 20 00:47:47.232348 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.232305    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rxsh4" podStartSLOduration=3.987968895 podStartE2EDuration="21.232288994s" totalImagesPullingTime="17.244320099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:47.232285198 +0000 UTC m=+23.481786995" watchObservedRunningTime="2026-09-20 00:47:47.232288994 +0000 UTC m=+23.481790799"
Sep 20 00:47:47.245265 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.245218    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mkbhg" podStartSLOduration=11.258286865 podStartE2EDuration="21.245203269s" totalImagesPullingTime="9.986916404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:47.245167942 +0000 UTC m=+23.494669748" watchObservedRunningTime="2026-09-20 00:47:47.245203269 +0000 UTC m=+23.494705068"
Sep 20 00:47:47.265295 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.265258    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vxc8n" podStartSLOduration=4.01166747 podStartE2EDuration="21.265241629s" totalImagesPullingTime="17.253574159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:47.264840217 +0000 UTC m=+23.514342022" watchObservedRunningTime="2026-09-20 00:47:47.265241629 +0000 UTC m=+23.514743432"
Sep 20 00:47:47.434586 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.434562    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 20 00:47:47.981564 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.981525    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:47.981777 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:47.981664    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:47.996668 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.996561    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-20T00:47:47.434582019Z","UUID":"663d9c4f-baac-4517-905a-245cabf74909","Handler":null,"Name":"","Endpoint":""}
Sep 20 00:47:47.999724 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.999692    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 20 00:47:47.999724 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:47.999728    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 20 00:47:48.186606 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:48.186569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8bx6r" event={"ID":"0bd6af89-013a-4cca-a36c-7bebd4a5f11b","Type":"ContainerStarted","Data":"fee740709fc3d1fc4390ad45349ed42012df36f415d31d371033430bec4bbbe6"}
Sep 20 00:47:48.188977 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:48.188947    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r" event={"ID":"927586c6-0af0-43c3-821c-61140206edaa","Type":"ContainerStarted","Data":"d3575d341a0780be55b696ffef96bcf84c286db61a992fccf1df885389b5714d"}
Sep 20 00:47:48.199816 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:48.199769    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8bx6r" podStartSLOduration=4.955825442 podStartE2EDuration="22.19975579s" totalImagesPullingTime="17.243930348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:48.199416317 +0000 UTC m=+24.448918122" watchObservedRunningTime="2026-09-20 00:47:48.19975579 +0000 UTC m=+24.449257598"
Sep 20 00:47:48.981680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:48.981643    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:48.981870 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:48.981655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:48.981870 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:48.981792    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:48.981870 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:48.981862    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:49.194351 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:49.194085    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r" event={"ID":"927586c6-0af0-43c3-821c-61140206edaa","Type":"ContainerStarted","Data":"6267c8ff68093217a868d5ae4b6b841ae4b3d3a30101db626d112927d3c11a35"}
Sep 20 00:47:49.198329 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:49.198269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"304e8a0fe0d226b05a65e21a30b886ff835cfbba48e6bcea81589b2be7ff7cc8"}
Sep 20 00:47:49.209712 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:49.209669    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r596r" podStartSLOduration=4.233274908 podStartE2EDuration="23.2096548s" totalImagesPullingTime="18.976379892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:49.208999264 +0000 UTC m=+25.458501067" watchObservedRunningTime="2026-09-20 00:47:49.2096548 +0000 UTC m=+25.459156604"
Sep 20 00:47:49.984583 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:49.984554    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:49.984763 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:49.984665    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:50.981587 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:50.981554    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:50.982207 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:50.981669    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:50.982207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:50.981732    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:50.982207 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:50.981862    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:51.249096 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:51.248958    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:51.249870 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:51.249618    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:51.981657 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:51.981480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:51.982288 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:51.981728    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:52.208128 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.208091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" event={"ID":"3aeee648-94b7-4808-9dda-aaaf9d728251","Type":"ContainerStarted","Data":"450a3a86984a4c99f5a948820071e618fffcc484eb4e2beae870da4d47d350e4"}
Sep 20 00:47:52.208446 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.208420    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:52.208571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.208487    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:52.209989 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.209967    2568 generic.go:356] "Generic (PLEG): container finished" podID="0dbb192c-cf1d-485b-8777-72ee430191fe" containerID="252396edcb23ed0025941d40676c715bb3607efe9a26fa9c26a799b91f9f2740" exitCode=0
Sep 20 00:47:52.210104 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.210061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerDied","Data":"252396edcb23ed0025941d40676c715bb3607efe9a26fa9c26a799b91f9f2740"}
Sep 20 00:47:52.210208 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.210186    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:52.211267 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.210685    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mkbhg"
Sep 20 00:47:52.224825 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.224805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:52.231139 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.231103    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj" podStartSLOduration=8.964643937 podStartE2EDuration="26.231090132s" totalImagesPullingTime="17.266446195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:52.230546294 +0000 UTC m=+28.480048109" watchObservedRunningTime="2026-09-20 00:47:52.231090132 +0000 UTC m=+28.480591957"
Sep 20 00:47:52.981645 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.981608    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:52.981799 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:52.981737    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:52.981799 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:52.981779    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:52.982198 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:52.981859    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:53.109648 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.109619    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n742d"]
Sep 20 00:47:53.112674 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.112648    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zfszg"]
Sep 20 00:47:53.112824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.112804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:53.112956 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:53.112933    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:53.113401 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.113363    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nph9k"]
Sep 20 00:47:53.212742 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.212717    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:53.212742 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.212730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:53.212989 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:53.212961    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:53.213072 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.213061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:53.213270 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:53.213233    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:53.230319 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:53.230297    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:47:54.219109 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:54.219073    2568 generic.go:356] "Generic (PLEG): container finished" podID="0dbb192c-cf1d-485b-8777-72ee430191fe" containerID="2453c9aacd984a8fc3f2473d588b86607ea3b10c229d44177924660ab9d07b1d" exitCode=0
Sep 20 00:47:54.219501 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:54.219117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerDied","Data":"2453c9aacd984a8fc3f2473d588b86607ea3b10c229d44177924660ab9d07b1d"}
Sep 20 00:47:54.981020 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:54.980990    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:54.981183 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:54.981026    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:54.981183 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:54.981077    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:54.981183 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:54.981093    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:54.981183 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:54.981147    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:54.981321 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:54.981221    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:56.226348 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:56.226063    2568 generic.go:356] "Generic (PLEG): container finished" podID="0dbb192c-cf1d-485b-8777-72ee430191fe" containerID="937cd5b292973ff362a62f4c47b0848261636fda1e4987326421915ba4d3b461" exitCode=0
Sep 20 00:47:56.226348 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:56.226151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerDied","Data":"937cd5b292973ff362a62f4c47b0848261636fda1e4987326421915ba4d3b461"}
Sep 20 00:47:56.981482 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:56.981448    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:56.981679 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:56.981558    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:56.981679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:56.981454    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:56.981679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:56.981587    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:56.981852 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:56.981701    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:56.981852 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:56.981802    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:58.981173 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:58.981140    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:58.981812 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:58.981141    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:58.981812 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:58.981267    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nph9k" podUID="bafb2e84-f0f7-499d-a96f-8385327a0b63"
Sep 20 00:47:58.981812 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:58.981141    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:58.981812 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:58.981365    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n742d" podUID="ca261dfa-0300-498b-9f0e-f21d394d8ee6"
Sep 20 00:47:58.981812 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:58.981446    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zfszg" podUID="86f97874-4050-47d0-a0a7-aff13bac587f"
Sep 20 00:47:59.262367 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.262342    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-21.ec2.internal" event="NodeReady"
Sep 20 00:47:59.262534 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.262471    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 20 00:47:59.297526 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.297486    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f877b5d76-g48vt"]
Sep 20 00:47:59.328245 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.328213    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7454f65595-lpv4b"]
Sep 20 00:47:59.328997 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.328971    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.331274 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.331246    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 20 00:47:59.331550 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.331532    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 20 00:47:59.332083 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.332066    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 20 00:47:59.332531 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.332509    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 20 00:47:59.332727 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.332711    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.332934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.332725    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.333831 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.333812    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6rsk8\""
Sep 20 00:47:59.354551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.354514    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-d6bg5"]
Sep 20 00:47:59.354796 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.354774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.356983 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.356960    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 20 00:47:59.357077 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.357032    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 20 00:47:59.357207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.357187    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g8fk6\""
Sep 20 00:47:59.357301 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.357193    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 20 00:47:59.366031 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.366009    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 20 00:47:59.370572 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.370550    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"]
Sep 20 00:47:59.370689 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.370669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.374091 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.374069    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.374207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.374115    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 20 00:47:59.374207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.374191    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 20 00:47:59.374384 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.374366    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.374654 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.374534    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b5gt4\""
Sep 20 00:47:59.379100 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.379077    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 20 00:47:59.388596 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.388577    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"]
Sep 20 00:47:59.388706 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.388690    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.390983 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.390964    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 20 00:47:59.391110 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.391010    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.391220 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.391135    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.391220 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.391056    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lvrd6\""
Sep 20 00:47:59.392133 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.392116    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 20 00:47:59.408236 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.408216    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"]
Sep 20 00:47:59.408359 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.408341    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"
Sep 20 00:47:59.410183 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.410164    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.410457 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.410441    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x9jl4\""
Sep 20 00:47:59.410700 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.410682    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.428373 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.428353    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zb4cn"]
Sep 20 00:47:59.428506 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.428487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.430886 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.430632    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 20 00:47:59.430886 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.430675    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.430886 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.430777    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zvv57\""
Sep 20 00:47:59.430886 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.430848    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 20 00:47:59.431153 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.431059    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.452068 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.452003    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"]
Sep 20 00:47:59.452181 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.452121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.455896 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.455877    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 20 00:47:59.455896 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.455891    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.456070 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.455938    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 20 00:47:59.456354 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.456336    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lw78l\""
Sep 20 00:47:59.456432 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.456400    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.461322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.461303    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 20 00:47:59.469883 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.469864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e37bb20-cc8d-43c8-9638-2546fc676ce4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.469986 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.469890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/658d8f90-8dda-48c4-82d7-397dfd77d262-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.469986 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.469937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-image-registry-private-configuration\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470097 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6030f81-6bcc-451d-9b7b-f9dfed272825-ca-trust-extracted\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470097 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-certificates\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470097 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e37bb20-cc8d-43c8-9638-2546fc676ce4-snapshots\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.470220 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-stats-auth\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.470220 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e37bb20-cc8d-43c8-9638-2546fc676ce4-serving-cert\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.470220 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.470220 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470192    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tb4p\" (UniqueName: \"kubernetes.io/projected/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-kube-api-access-2tb4p\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.470398 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qh49\" (UniqueName: \"kubernetes.io/projected/658d8f90-8dda-48c4-82d7-397dfd77d262-kube-api-access-4qh49\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.470398 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-trusted-ca\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470398 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.470398 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-bound-sa-token\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470398 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470330    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlmtd\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-kube-api-access-dlmtd\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmlj\" (UniqueName: \"kubernetes.io/projected/1e37bb20-cc8d-43c8-9638-2546fc676ce4-kube-api-access-pxmlj\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e37bb20-cc8d-43c8-9638-2546fc676ce4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470578    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-installation-pull-secrets\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470608    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e37bb20-cc8d-43c8-9638-2546fc676ce4-tmp\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.470638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.470634    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-default-certificate\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.476185 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.476166    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"]
Sep 20 00:47:59.476316 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.476297    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.481316 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.481292    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 20 00:47:59.481444 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.481380    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.481515 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.481383    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 20 00:47:59.481515 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.481481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x7hdk\""
Sep 20 00:47:59.481626 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.481563    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.492173 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.492156    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"]
Sep 20 00:47:59.492275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.492251    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:47:59.494673 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.494657    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5xhhs\""
Sep 20 00:47:59.494768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.494673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 20 00:47:59.494768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.494690    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.494901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.494883    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.508375 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.508354    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6p6f6"]
Sep 20 00:47:59.508473 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.508465    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"
Sep 20 00:47:59.510432 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.510410    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.510530 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.510456    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.510594 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.510561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-glwtg\""
Sep 20 00:47:59.532477 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.532453    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwwdz"]
Sep 20 00:47:59.532597 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.532582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.534963 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.534942    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 20 00:47:59.535067 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.535039    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wd7tm\""
Sep 20 00:47:59.535132 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.535119    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 20 00:47:59.558023 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.557998    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"]
Sep 20 00:47:59.558023 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558024    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f877b5d76-g48vt"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558042    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-d6bg5"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558060    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558079    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558128    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558148    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwwdz"]
Sep 20 00:47:59.558167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558166    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"]
Sep 20 00:47:59.558430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558100    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.558430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zb4cn"]
Sep 20 00:47:59.558430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7454f65595-lpv4b"]
Sep 20 00:47:59.558430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.558212    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6p6f6"]
Sep 20 00:47:59.560306 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.560284    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 20 00:47:59.560417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.560312    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 20 00:47:59.560417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.560362    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 20 00:47:59.560417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.560368    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bsbfw\""
Sep 20 00:47:59.571526 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de73791e-b2cd-4357-a667-0f5dfe3032fa-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.571616 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5028ec9d-2e42-4ec0-be26-e9605573311d-config\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.571616 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e37bb20-cc8d-43c8-9638-2546fc676ce4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.571733 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.571733 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.571887 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.571752    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:00.071734226 +0000 UTC m=+36.321236023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : configmap references non-existent config key: service-ca.crt
Sep 20 00:47:59.571887 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.571802    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:47:59.571887 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.571816    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454f65595-lpv4b: secret "image-registry-tls" not found
Sep 20 00:47:59.571887 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-image-registry-private-configuration\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.571887 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:47:59.571887 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.571859    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls podName:b6030f81-6bcc-451d-9b7b-f9dfed272825 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:00.071845938 +0000 UTC m=+36.321347734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls") pod "image-registry-7454f65595-lpv4b" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825") : secret "image-registry-tls" not found
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/658d8f90-8dda-48c4-82d7-397dfd77d262-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c608f222-85e5-4d66-9612-43cda7de1b31-serving-cert\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6030f81-6bcc-451d-9b7b-f9dfed272825-ca-trust-extracted\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.571989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-certificates\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de73791e-b2cd-4357-a667-0f5dfe3032fa-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-stats-auth\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g77f\" (UniqueName: \"kubernetes.io/projected/5028ec9d-2e42-4ec0-be26-e9605573311d-kube-api-access-8g77f\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e37bb20-cc8d-43c8-9638-2546fc676ce4-serving-cert\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572139    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tb4p\" (UniqueName: \"kubernetes.io/projected/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-kube-api-access-2tb4p\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572167    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e37bb20-cc8d-43c8-9638-2546fc676ce4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.572207 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-trusted-ca\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.572820 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/658d8f90-8dda-48c4-82d7-397dfd77d262-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.572820 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.572784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6030f81-6bcc-451d-9b7b-f9dfed272825-ca-trust-extracted\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.572949 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.572877    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 20 00:47:59.573008 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.572952    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls podName:658d8f90-8dda-48c4-82d7-397dfd77d262 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:00.072937286 +0000 UTC m=+36.322439067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcrb" (UID: "658d8f90-8dda-48c4-82d7-397dfd77d262") : secret "cluster-monitoring-operator-tls" not found
Sep 20 00:47:59.573078 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573062    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-trusted-ca\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.573132 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-certificates\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.573188 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-bound-sa-token\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.573188 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5028ec9d-2e42-4ec0-be26-e9605573311d-serving-cert\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.573286 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlmtd\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-kube-api-access-dlmtd\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.573286 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-installation-pull-secrets\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.573286 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573258    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmlj\" (UniqueName: \"kubernetes.io/projected/1e37bb20-cc8d-43c8-9638-2546fc676ce4-kube-api-access-pxmlj\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.573430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573289    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qlh9\" (UniqueName: \"kubernetes.io/projected/5ac18d02-6b0f-4f16-854f-103b60357b0b-kube-api-access-2qlh9\") pod \"volume-data-source-validator-5c4db8bdf9-5j9rq\" (UID: \"5ac18d02-6b0f-4f16-854f-103b60357b0b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"
Sep 20 00:47:59.573430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e37bb20-cc8d-43c8-9638-2546fc676ce4-tmp\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.573430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-default-certificate\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.573430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e37bb20-cc8d-43c8-9638-2546fc676ce4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.573430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srldl\" (UniqueName: \"kubernetes.io/projected/23e68ae5-bf8f-4f32-adc7-7446dd28494a-kube-api-access-srldl\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:47:59.573430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573422    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c608f222-85e5-4d66-9612-43cda7de1b31-trusted-ca\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.573734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e37bb20-cc8d-43c8-9638-2546fc676ce4-snapshots\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.573734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qh49\" (UniqueName: \"kubernetes.io/projected/658d8f90-8dda-48c4-82d7-397dfd77d262-kube-api-access-4qh49\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.573734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbb6b\" (UniqueName: \"kubernetes.io/projected/de73791e-b2cd-4357-a667-0f5dfe3032fa-kube-api-access-sbb6b\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.573734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swxw\" (UniqueName: \"kubernetes.io/projected/c608f222-85e5-4d66-9612-43cda7de1b31-kube-api-access-9swxw\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.573734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.573734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.573581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c608f222-85e5-4d66-9612-43cda7de1b31-config\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.574372 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.574351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e37bb20-cc8d-43c8-9638-2546fc676ce4-snapshots\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.574472 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.574457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e37bb20-cc8d-43c8-9638-2546fc676ce4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.574571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.574525    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e37bb20-cc8d-43c8-9638-2546fc676ce4-tmp\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.574571 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.574568    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 20 00:47:59.574692 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.574642    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:00.074625209 +0000 UTC m=+36.324127005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : secret "router-metrics-certs-default" not found
Sep 20 00:47:59.577111 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.577089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e37bb20-cc8d-43c8-9638-2546fc676ce4-serving-cert\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.577231 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.577124    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-image-registry-private-configuration\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.577231 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.577148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-installation-pull-secrets\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.577231 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.577224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-stats-auth\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.577369 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.577281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-default-certificate\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.584155 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.584092    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tb4p\" (UniqueName: \"kubernetes.io/projected/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-kube-api-access-2tb4p\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:47:59.584155 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.584096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-bound-sa-token\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.584444 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.584288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qh49\" (UniqueName: \"kubernetes.io/projected/658d8f90-8dda-48c4-82d7-397dfd77d262-kube-api-access-4qh49\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:47:59.585414 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.585315    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlmtd\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-kube-api-access-dlmtd\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:47:59.585722 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.585680    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmlj\" (UniqueName: \"kubernetes.io/projected/1e37bb20-cc8d-43c8-9638-2546fc676ce4-kube-api-access-pxmlj\") pod \"insights-operator-6f9c644dd9-d6bg5\" (UID: \"1e37bb20-cc8d-43c8-9638-2546fc676ce4\") " pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.674852 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.674818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:47:59.675054 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.674872    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qlh9\" (UniqueName: \"kubernetes.io/projected/5ac18d02-6b0f-4f16-854f-103b60357b0b-kube-api-access-2qlh9\") pod \"volume-data-source-validator-5c4db8bdf9-5j9rq\" (UID: \"5ac18d02-6b0f-4f16-854f-103b60357b0b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"
Sep 20 00:47:59.675054 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.674911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zkz\" (UniqueName: \"kubernetes.io/projected/2a87d3b0-8e92-4273-a582-d734c67c8c18-kube-api-access-79zkz\") pod \"ingress-canary-vwwdz\" (UID: \"2a87d3b0-8e92-4273-a582-d734c67c8c18\") " pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.675054 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.674953    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwp6b\" (UniqueName: \"kubernetes.io/projected/20daa791-eb6d-4819-998f-4a5b13ccc66e-kube-api-access-pwp6b\") pod \"network-check-source-7cbc45fddc-bm4p7\" (UID: \"20daa791-eb6d-4819-998f-4a5b13ccc66e\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"
Sep 20 00:47:59.675054 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.674982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cfec327-8405-465e-8afb-e10959dfe4be-tmp-dir\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.675054 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.675001    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.675074    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret podName:ca261dfa-0300-498b-9f0e-f21d394d8ee6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.675056381 +0000 UTC m=+67.924558163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret") pod "global-pull-secret-syncer-n742d" (UID: "ca261dfa-0300-498b-9f0e-f21d394d8ee6") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675126    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srldl\" (UniqueName: \"kubernetes.io/projected/23e68ae5-bf8f-4f32-adc7-7446dd28494a-kube-api-access-srldl\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c608f222-85e5-4d66-9612-43cda7de1b31-trusted-ca\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675195    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbb6b\" (UniqueName: \"kubernetes.io/projected/de73791e-b2cd-4357-a667-0f5dfe3032fa-kube-api-access-sbb6b\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675221    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swxw\" (UniqueName: \"kubernetes.io/projected/c608f222-85e5-4d66-9612-43cda7de1b31-kube-api-access-9swxw\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675258    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c608f222-85e5-4d66-9612-43cda7de1b31-config\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.675322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cfec327-8405-465e-8afb-e10959dfe4be-config-volume\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675334    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de73791e-b2cd-4357-a667-0f5dfe3032fa-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5028ec9d-2e42-4ec0-be26-e9605573311d-config\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snz4z\" (UniqueName: \"kubernetes.io/projected/0cfec327-8405-465e-8afb-e10959dfe4be-kube-api-access-snz4z\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a87d3b0-8e92-4273-a582-d734c67c8c18-cert\") pod \"ingress-canary-vwwdz\" (UID: \"2a87d3b0-8e92-4273-a582-d734c67c8c18\") " pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c608f222-85e5-4d66-9612-43cda7de1b31-serving-cert\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de73791e-b2cd-4357-a667-0f5dfe3032fa-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g77f\" (UniqueName: \"kubernetes.io/projected/5028ec9d-2e42-4ec0-be26-e9605573311d-kube-api-access-8g77f\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5028ec9d-2e42-4ec0-be26-e9605573311d-serving-cert\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.675659 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.675653    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.676414 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.676237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c608f222-85e5-4d66-9612-43cda7de1b31-config\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.676414 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.676325    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5028ec9d-2e42-4ec0-be26-e9605573311d-config\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.676414 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.676341    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 20 00:47:59.676414 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.676355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c608f222-85e5-4d66-9612-43cda7de1b31-trusted-ca\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.676414 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.676390    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls podName:23e68ae5-bf8f-4f32-adc7-7446dd28494a nodeName:}" failed. No retries permitted until 2026-09-20 00:48:00.176374626 +0000 UTC m=+36.425876413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-qqhlg" (UID: "23e68ae5-bf8f-4f32-adc7-7446dd28494a") : secret "samples-operator-tls" not found
Sep 20 00:47:59.676728 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.676471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de73791e-b2cd-4357-a667-0f5dfe3032fa-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.678285 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.678261    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de73791e-b2cd-4357-a667-0f5dfe3032fa-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.678408 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.678307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c608f222-85e5-4d66-9612-43cda7de1b31-serving-cert\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.678495 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.678478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5028ec9d-2e42-4ec0-be26-e9605573311d-serving-cert\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.680276 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.680250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5"
Sep 20 00:47:59.689472 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.689451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbb6b\" (UniqueName: \"kubernetes.io/projected/de73791e-b2cd-4357-a667-0f5dfe3032fa-kube-api-access-sbb6b\") pod \"kube-storage-version-migrator-operator-55889f7b47-4ptkx\" (UID: \"de73791e-b2cd-4357-a667-0f5dfe3032fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.689569 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.689451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srldl\" (UniqueName: \"kubernetes.io/projected/23e68ae5-bf8f-4f32-adc7-7446dd28494a-kube-api-access-srldl\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:47:59.689643 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.689623    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g77f\" (UniqueName: \"kubernetes.io/projected/5028ec9d-2e42-4ec0-be26-e9605573311d-kube-api-access-8g77f\") pod \"service-ca-operator-57cdc4b768-rwn8q\" (UID: \"5028ec9d-2e42-4ec0-be26-e9605573311d\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.689820 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.689781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swxw\" (UniqueName: \"kubernetes.io/projected/c608f222-85e5-4d66-9612-43cda7de1b31-kube-api-access-9swxw\") pod \"console-operator-fd4bb46c-zb4cn\" (UID: \"c608f222-85e5-4d66-9612-43cda7de1b31\") " pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.690364 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.689790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qlh9\" (UniqueName: \"kubernetes.io/projected/5ac18d02-6b0f-4f16-854f-103b60357b0b-kube-api-access-2qlh9\") pod \"volume-data-source-validator-5c4db8bdf9-5j9rq\" (UID: \"5ac18d02-6b0f-4f16-854f-103b60357b0b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"
Sep 20 00:47:59.718460 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.718429    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"
Sep 20 00:47:59.738739 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.738721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"
Sep 20 00:47:59.761890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.761866    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:47:59.776227 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:59.776353 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snz4z\" (UniqueName: \"kubernetes.io/projected/0cfec327-8405-465e-8afb-e10959dfe4be-kube-api-access-snz4z\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.776423 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a87d3b0-8e92-4273-a582-d734c67c8c18-cert\") pod \"ingress-canary-vwwdz\" (UID: \"2a87d3b0-8e92-4273-a582-d734c67c8c18\") " pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.776494 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.776624 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:47:59.776624 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zkz\" (UniqueName: \"kubernetes.io/projected/2a87d3b0-8e92-4273-a582-d734c67c8c18-kube-api-access-79zkz\") pod \"ingress-canary-vwwdz\" (UID: \"2a87d3b0-8e92-4273-a582-d734c67c8c18\") " pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.776624 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwp6b\" (UniqueName: \"kubernetes.io/projected/20daa791-eb6d-4819-998f-4a5b13ccc66e-kube-api-access-pwp6b\") pod \"network-check-source-7cbc45fddc-bm4p7\" (UID: \"20daa791-eb6d-4819-998f-4a5b13ccc66e\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"
Sep 20 00:47:59.776624 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.776600    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:47:59.776873 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.776631    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:59.776873 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.776659    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls podName:0cfec327-8405-465e-8afb-e10959dfe4be nodeName:}" failed. No retries permitted until 2026-09-20 00:48:00.276639275 +0000 UTC m=+36.526141065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls") pod "dns-default-6p6f6" (UID: "0cfec327-8405-465e-8afb-e10959dfe4be") : secret "dns-default-metrics-tls" not found
Sep 20 00:47:59.776873 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cfec327-8405-465e-8afb-e10959dfe4be-tmp-dir\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.776873 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:47:59.776688    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs podName:bafb2e84-f0f7-499d-a96f-8385327a0b63 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.776673245 +0000 UTC m=+68.026175030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs") pod "network-metrics-daemon-nph9k" (UID: "bafb2e84-f0f7-499d-a96f-8385327a0b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:59.776873 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.776755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cfec327-8405-465e-8afb-e10959dfe4be-config-volume\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.777151 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.777073    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cfec327-8405-465e-8afb-e10959dfe4be-tmp-dir\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.777415 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.777379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cfec327-8405-465e-8afb-e10959dfe4be-config-volume\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.779346 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.779322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a87d3b0-8e92-4273-a582-d734c67c8c18-cert\") pod \"ingress-canary-vwwdz\" (UID: \"2a87d3b0-8e92-4273-a582-d734c67c8c18\") " pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.779455 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.779433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj68q\" (UniqueName: \"kubernetes.io/projected/86f97874-4050-47d0-a0a7-aff13bac587f-kube-api-access-zj68q\") pod \"network-check-target-zfszg\" (UID: \"86f97874-4050-47d0-a0a7-aff13bac587f\") " pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:47:59.784729 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.784708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snz4z\" (UniqueName: \"kubernetes.io/projected/0cfec327-8405-465e-8afb-e10959dfe4be-kube-api-access-snz4z\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:47:59.784830 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.784781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zkz\" (UniqueName: \"kubernetes.io/projected/2a87d3b0-8e92-4273-a582-d734c67c8c18-kube-api-access-79zkz\") pod \"ingress-canary-vwwdz\" (UID: \"2a87d3b0-8e92-4273-a582-d734c67c8c18\") " pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:47:59.784905 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.784884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwp6b\" (UniqueName: \"kubernetes.io/projected/20daa791-eb6d-4819-998f-4a5b13ccc66e-kube-api-access-pwp6b\") pod \"network-check-source-7cbc45fddc-bm4p7\" (UID: \"20daa791-eb6d-4819-998f-4a5b13ccc66e\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"
Sep 20 00:47:59.788553 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.788526    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"
Sep 20 00:47:59.819378 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.819358    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"
Sep 20 00:47:59.867592 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:47:59.867567    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwwdz"
Sep 20 00:48:00.079905 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.079810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:00.079905 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.079868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.079999    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.080006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080009    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:01.079992509 +0000 UTC m=+37.329494306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : configmap references non-existent config key: service-ca.crt
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080093    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080114    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454f65595-lpv4b: secret "image-registry-tls" not found
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080118    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:01.080096406 +0000 UTC m=+37.329598201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : secret "router-metrics-certs-default" not found
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080148    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls podName:b6030f81-6bcc-451d-9b7b-f9dfed272825 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:01.080138026 +0000 UTC m=+37.329639808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls") pod "image-registry-7454f65595-lpv4b" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825") : secret "image-registry-tls" not found
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.080205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080316    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:00.080665 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.080355    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls podName:658d8f90-8dda-48c4-82d7-397dfd77d262 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:01.080346638 +0000 UTC m=+37.329848419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcrb" (UID: "658d8f90-8dda-48c4-82d7-397dfd77d262") : secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:00.181390 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.181352    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:00.181552 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.181487    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 20 00:48:00.181603 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.181552    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls podName:23e68ae5-bf8f-4f32-adc7-7446dd28494a nodeName:}" failed. No retries permitted until 2026-09-20 00:48:01.181534172 +0000 UTC m=+37.431035961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-qqhlg" (UID: "23e68ae5-bf8f-4f32-adc7-7446dd28494a") : secret "samples-operator-tls" not found
Sep 20 00:48:00.282218 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.282177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:00.282376 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.282338    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:00.282424 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:00.282407    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls podName:0cfec327-8405-465e-8afb-e10959dfe4be nodeName:}" failed. No retries permitted until 2026-09-20 00:48:01.282392657 +0000 UTC m=+37.531894438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls") pod "dns-default-6p6f6" (UID: "0cfec327-8405-465e-8afb-e10959dfe4be") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:00.982233 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.980861    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:48:00.982233 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.981357    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:48:00.982233 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.981820    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:48:00.986512 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.986181    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 00:48:00.986512 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.986402    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 00:48:00.993662 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.993631    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkppn\""
Sep 20 00:48:00.993957 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:00.993939    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fnqwj\""
Sep 20 00:48:01.006247 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.006227    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:48:01.090293 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.090264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.090323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.090350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.090411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090431    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090478    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.090457345 +0000 UTC m=+39.339959132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : configmap references non-existent config key: service-ca.crt
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090498    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090515    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454f65595-lpv4b: secret "image-registry-tls" not found
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090500    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.090493372 +0000 UTC m=+39.339995156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : secret "router-metrics-certs-default" not found
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090502    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090630    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls podName:658d8f90-8dda-48c4-82d7-397dfd77d262 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.090615181 +0000 UTC m=+39.340116984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcrb" (UID: "658d8f90-8dda-48c4-82d7-397dfd77d262") : secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:01.090809 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.090644    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls podName:b6030f81-6bcc-451d-9b7b-f9dfed272825 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.090637374 +0000 UTC m=+39.340139156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls") pod "image-registry-7454f65595-lpv4b" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825") : secret "image-registry-tls" not found
Sep 20 00:48:01.191450 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.191388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:01.191567 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.191551    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 20 00:48:01.191619 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.191614    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls podName:23e68ae5-bf8f-4f32-adc7-7446dd28494a nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.191601062 +0000 UTC m=+39.441102856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-qqhlg" (UID: "23e68ae5-bf8f-4f32-adc7-7446dd28494a") : secret "samples-operator-tls" not found
Sep 20 00:48:01.194298 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.194142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwwdz"]
Sep 20 00:48:01.195463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.195442    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q"]
Sep 20 00:48:01.199549 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.199524    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq"]
Sep 20 00:48:01.199754 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.199741    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7"]
Sep 20 00:48:01.202676 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.202653    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx"]
Sep 20 00:48:01.209705 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.209684    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zb4cn"]
Sep 20 00:48:01.210872 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.210853    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-d6bg5"]
Sep 20 00:48:01.217247 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:01.216799    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e37bb20_cc8d_43c8_9638_2546fc676ce4.slice/crio-5a5bc7a7db7826371f6049d2eeeec92935e797f447f8510668cae6a01d9f4cea WatchSource:0}: Error finding container 5a5bc7a7db7826371f6049d2eeeec92935e797f447f8510668cae6a01d9f4cea: Status 404 returned error can't find the container with id 5a5bc7a7db7826371f6049d2eeeec92935e797f447f8510668cae6a01d9f4cea
Sep 20 00:48:01.242444 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.242409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq" event={"ID":"5ac18d02-6b0f-4f16-854f-103b60357b0b","Type":"ContainerStarted","Data":"d7f65f7918d0a0e146a12b3a50002ef475ac933d021e75fa844a879e4f3d731b"}
Sep 20 00:48:01.243819 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.243767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7" event={"ID":"20daa791-eb6d-4819-998f-4a5b13ccc66e","Type":"ContainerStarted","Data":"8f522da87b5a166d0ac3b2fd3c2294f34512217cc0bc5b220479c1754533c674"}
Sep 20 00:48:01.245293 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.245268    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx" event={"ID":"de73791e-b2cd-4357-a667-0f5dfe3032fa","Type":"ContainerStarted","Data":"1f4bbfdc587663214faa8b198e8c829efd42a1f59ae51e603b16a1cc6d2704c2"}
Sep 20 00:48:01.246495 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.246475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" event={"ID":"c608f222-85e5-4d66-9612-43cda7de1b31","Type":"ContainerStarted","Data":"72875c1ed5b4230037ae346d08b783d311490edcf873b52113f2473c98fa7875"}
Sep 20 00:48:01.247688 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.247645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwwdz" event={"ID":"2a87d3b0-8e92-4273-a582-d734c67c8c18","Type":"ContainerStarted","Data":"e9743dfccd99f24a23e9025d18d94fc1b53d32129b4f2badd799b3c39a84fb72"}
Sep 20 00:48:01.248957 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.248941    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5" event={"ID":"1e37bb20-cc8d-43c8-9638-2546fc676ce4","Type":"ContainerStarted","Data":"5a5bc7a7db7826371f6049d2eeeec92935e797f447f8510668cae6a01d9f4cea"}
Sep 20 00:48:01.250110 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.250092    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q" event={"ID":"5028ec9d-2e42-4ec0-be26-e9605573311d","Type":"ContainerStarted","Data":"47cc0209270b24d15a218e8a50f2178b72be5a99c6f95979e7da94e0ac60d0e3"}
Sep 20 00:48:01.292625 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.292589    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:01.292791 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.292768    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:01.292874 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:01.292851    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls podName:0cfec327-8405-465e-8afb-e10959dfe4be nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.292830882 +0000 UTC m=+39.542332670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls") pod "dns-default-6p6f6" (UID: "0cfec327-8405-465e-8afb-e10959dfe4be") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:01.442573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:01.442542    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zfszg"]
Sep 20 00:48:01.447003 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:01.446960    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f97874_4050_47d0_a0a7_aff13bac587f.slice/crio-72525364e11c693dd54b7b6a97405731ecccd18550fc5ca8d53dae6ac19cda02 WatchSource:0}: Error finding container 72525364e11c693dd54b7b6a97405731ecccd18550fc5ca8d53dae6ac19cda02: Status 404 returned error can't find the container with id 72525364e11c693dd54b7b6a97405731ecccd18550fc5ca8d53dae6ac19cda02
Sep 20 00:48:02.258572 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:02.258532    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zfszg" event={"ID":"86f97874-4050-47d0-a0a7-aff13bac587f","Type":"ContainerStarted","Data":"72525364e11c693dd54b7b6a97405731ecccd18550fc5ca8d53dae6ac19cda02"}
Sep 20 00:48:02.266427 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:02.266396    2568 generic.go:356] "Generic (PLEG): container finished" podID="0dbb192c-cf1d-485b-8777-72ee430191fe" containerID="f73b58001675845f1d5bec324d1a0aeff77bb2749e61b029bb16aa3957c6f85f" exitCode=0
Sep 20 00:48:02.266574 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:02.266444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerDied","Data":"f73b58001675845f1d5bec324d1a0aeff77bb2749e61b029bb16aa3957c6f85f"}
Sep 20 00:48:03.111851 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.111808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:03.112060 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.111886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:03.112060 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.111938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:03.112060 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.112005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:03.112243 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112201    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:03.112306 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112275    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls podName:658d8f90-8dda-48c4-82d7-397dfd77d262 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.112248589 +0000 UTC m=+43.361750376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcrb" (UID: "658d8f90-8dda-48c4-82d7-397dfd77d262") : secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:03.112805 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112693    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.112673783 +0000 UTC m=+43.362175579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : configmap references non-existent config key: service-ca.crt
Sep 20 00:48:03.112805 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112703    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:03.112805 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112725    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454f65595-lpv4b: secret "image-registry-tls" not found
Sep 20 00:48:03.112805 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112763    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls podName:b6030f81-6bcc-451d-9b7b-f9dfed272825 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.112751864 +0000 UTC m=+43.362253661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls") pod "image-registry-7454f65595-lpv4b" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825") : secret "image-registry-tls" not found
Sep 20 00:48:03.112805 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112782    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 20 00:48:03.113147 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.112835    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.112820139 +0000 UTC m=+43.362321923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : secret "router-metrics-certs-default" not found
Sep 20 00:48:03.213147 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.212878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:03.213451 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.213429    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 20 00:48:03.213522 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.213504    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls podName:23e68ae5-bf8f-4f32-adc7-7446dd28494a nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.21348511 +0000 UTC m=+43.462986907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-qqhlg" (UID: "23e68ae5-bf8f-4f32-adc7-7446dd28494a") : secret "samples-operator-tls" not found
Sep 20 00:48:03.288611 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.287574    2568 generic.go:356] "Generic (PLEG): container finished" podID="0dbb192c-cf1d-485b-8777-72ee430191fe" containerID="33f0169f24fc010c819f2d455262d47977fdb2fe41a14d727445a685950d9c92" exitCode=0
Sep 20 00:48:03.288611 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.287640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerDied","Data":"33f0169f24fc010c819f2d455262d47977fdb2fe41a14d727445a685950d9c92"}
Sep 20 00:48:03.314662 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:03.313859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:03.314662 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.314170    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:03.314662 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:03.314232    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls podName:0cfec327-8405-465e-8afb-e10959dfe4be nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.314213281 +0000 UTC m=+43.563715087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls") pod "dns-default-6p6f6" (UID: "0cfec327-8405-465e-8afb-e10959dfe4be") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:04.301128 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:04.300893    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" event={"ID":"0dbb192c-cf1d-485b-8777-72ee430191fe","Type":"ContainerStarted","Data":"1583ea820332922416b6c55f74cf86b24500c45636cfee9149f610b1412f7974"}
Sep 20 00:48:04.325353 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:04.324150    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lq5zs" podStartSLOduration=10.023888925 podStartE2EDuration="38.324129103s" totalImagesPullingTime="28.300240178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:04.322650435 +0000 UTC m=+40.572152238" watchObservedRunningTime="2026-09-20 00:48:04.324129103 +0000 UTC m=+40.573630923"
Sep 20 00:48:07.149573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:07.149531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:07.149573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:07.149597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:07.149709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149741    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:07.149792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149820    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149836    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454f65595-lpv4b: secret "image-registry-tls" not found
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149824    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:15.149803807 +0000 UTC m=+51.399305612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : secret "router-metrics-certs-default" not found
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149866    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149897    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:15.14987844 +0000 UTC m=+51.399380232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : configmap references non-existent config key: service-ca.crt
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149949    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls podName:b6030f81-6bcc-451d-9b7b-f9dfed272825 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:15.149940385 +0000 UTC m=+51.399442170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls") pod "image-registry-7454f65595-lpv4b" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825") : secret "image-registry-tls" not found
Sep 20 00:48:07.150146 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.149966    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls podName:658d8f90-8dda-48c4-82d7-397dfd77d262 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:15.149957562 +0000 UTC m=+51.399459345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcrb" (UID: "658d8f90-8dda-48c4-82d7-397dfd77d262") : secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:07.250973 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:07.250928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:07.251165 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.251055    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 20 00:48:07.251165 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.251129    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls podName:23e68ae5-bf8f-4f32-adc7-7446dd28494a nodeName:}" failed. No retries permitted until 2026-09-20 00:48:15.251108146 +0000 UTC m=+51.500609929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-qqhlg" (UID: "23e68ae5-bf8f-4f32-adc7-7446dd28494a") : secret "samples-operator-tls" not found
Sep 20 00:48:07.352025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:07.351990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:07.352205 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.352154    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:07.352280 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:07.352221    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls podName:0cfec327-8405-465e-8afb-e10959dfe4be nodeName:}" failed. No retries permitted until 2026-09-20 00:48:15.352201619 +0000 UTC m=+51.601703402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls") pod "dns-default-6p6f6" (UID: "0cfec327-8405-465e-8afb-e10959dfe4be") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:10.320073 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.320036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwwdz" event={"ID":"2a87d3b0-8e92-4273-a582-d734c67c8c18","Type":"ContainerStarted","Data":"ac7ccff187ab65f3fbe9b50e4f49c38a83847639c64915daf112081aec03b091"}
Sep 20 00:48:10.321685 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.321661    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zfszg" event={"ID":"86f97874-4050-47d0-a0a7-aff13bac587f","Type":"ContainerStarted","Data":"e8de63498a995de5249cea4d443b9d5d22f5b34107dc471da9a358756ec9aacc"}
Sep 20 00:48:10.321796 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.321721    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:48:10.323525 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.323499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5" event={"ID":"1e37bb20-cc8d-43c8-9638-2546fc676ce4","Type":"ContainerStarted","Data":"bf7e2b24220b0c8238b1893ed932e8b09fc1adf348412791292aca1a6aacec96"}
Sep 20 00:48:10.325186 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.325163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q" event={"ID":"5028ec9d-2e42-4ec0-be26-e9605573311d","Type":"ContainerStarted","Data":"a23bf511ceb0567c197f1bd5027c4aef7a3db604b451af8b4a560ae4dc6b96ff"}
Sep 20 00:48:10.326857 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.326828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq" event={"ID":"5ac18d02-6b0f-4f16-854f-103b60357b0b","Type":"ContainerStarted","Data":"c6e208fa0a2accf78d0ccf6dd526c3973d6463c72db5b77b1d5c99244ab56adb"}
Sep 20 00:48:10.328555 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.328534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7" event={"ID":"20daa791-eb6d-4819-998f-4a5b13ccc66e","Type":"ContainerStarted","Data":"7477313cf1028018e43d1446b880e8bdeaf59e231ef49f9fbbe45ea342d10b12"}
Sep 20 00:48:10.330187 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.330164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx" event={"ID":"de73791e-b2cd-4357-a667-0f5dfe3032fa","Type":"ContainerStarted","Data":"20e3549ea05ad0e681e5a089ef86750755e46edec135676b6d66127844dc8614"}
Sep 20 00:48:10.331845 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.331827    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/0.log"
Sep 20 00:48:10.331940 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.331863    2568 generic.go:356] "Generic (PLEG): container finished" podID="c608f222-85e5-4d66-9612-43cda7de1b31" containerID="534014e9c6b6d2a5d9183fb060d3c782b52ee85103940e9f917aeb737a2b11a4" exitCode=255
Sep 20 00:48:10.331940 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.331900    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" event={"ID":"c608f222-85e5-4d66-9612-43cda7de1b31","Type":"ContainerDied","Data":"534014e9c6b6d2a5d9183fb060d3c782b52ee85103940e9f917aeb737a2b11a4"}
Sep 20 00:48:10.332135 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.332119    2568 scope.go:117] "RemoveContainer" containerID="534014e9c6b6d2a5d9183fb060d3c782b52ee85103940e9f917aeb737a2b11a4"
Sep 20 00:48:10.359209 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.359145    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwwdz" podStartSLOduration=3.240660916 podStartE2EDuration="11.359126128s" totalImagesPullingTime="8.118465212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.335367316 +0000 UTC m=+46.584869124" watchObservedRunningTime="2026-09-20 00:48:10.359126128 +0000 UTC m=+46.608627933"
Sep 20 00:48:10.359620 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.359511    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-5j9rq" podStartSLOduration=20.403066569 podStartE2EDuration="28.359501019s" totalImagesPullingTime="7.95643445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.358171793 +0000 UTC m=+46.607673599" watchObservedRunningTime="2026-09-20 00:48:10.359501019 +0000 UTC m=+46.609002824"
Sep 20 00:48:10.373235 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.373198    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bm4p7" podStartSLOduration=9.257254106 podStartE2EDuration="17.373186161s" totalImagesPullingTime="8.115932055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.37296531 +0000 UTC m=+46.622467119" watchObservedRunningTime="2026-09-20 00:48:10.373186161 +0000 UTC m=+46.622687964"
Sep 20 00:48:10.393323 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.393090    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx" podStartSLOduration=20.288516366 podStartE2EDuration="28.3930774s" totalImagesPullingTime="8.104561034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.39208073 +0000 UTC m=+46.641582534" watchObservedRunningTime="2026-09-20 00:48:10.3930774 +0000 UTC m=+46.642579203"
Sep 20 00:48:10.425890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.425832    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5" podStartSLOduration=30.322155655 podStartE2EDuration="38.425811227s" totalImagesPullingTime="8.103655572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.424158237 +0000 UTC m=+46.673660036" watchObservedRunningTime="2026-09-20 00:48:10.425811227 +0000 UTC m=+46.675313030"
Sep 20 00:48:10.438031 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.437982    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q" podStartSLOduration=20.328958666 podStartE2EDuration="28.437963395s" totalImagesPullingTime="8.109004729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.43757169 +0000 UTC m=+46.687073495" watchObservedRunningTime="2026-09-20 00:48:10.437963395 +0000 UTC m=+46.687465199"
Sep 20 00:48:10.452259 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:10.452215    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zfszg" podStartSLOduration=36.553599955 podStartE2EDuration="44.452200633s" totalImagesPullingTime="7.898600678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.451737261 +0000 UTC m=+46.701239066" watchObservedRunningTime="2026-09-20 00:48:10.452200633 +0000 UTC m=+46.701702436"
Sep 20 00:48:11.021239 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.021204    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9lqmf"]
Sep 20 00:48:11.023482 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.023460    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.025428 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.025410    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 20 00:48:11.025540 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.025456    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzh76\""
Sep 20 00:48:11.025607 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.025555    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 20 00:48:11.033719 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.033697    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9lqmf"]
Sep 20 00:48:11.086172 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.086131    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rm8d\" (UniqueName: \"kubernetes.io/projected/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-api-access-5rm8d\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.086172 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.086178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.086368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.086245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-crio-socket\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.086368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.086290    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-data-volume\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.086481 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.086433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187131 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187091    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rm8d\" (UniqueName: \"kubernetes.io/projected/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-api-access-5rm8d\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187131 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187345 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-crio-socket\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187345 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-data-volume\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187345 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187345 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.187298    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.187345 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187320    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-crio-socket\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.187585 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.187361    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:11.687342857 +0000 UTC m=+47.936844655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.187585 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.187405    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.187585 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.187451    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:11.687439025 +0000 UTC m=+47.936940811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.187729 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.187645    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-data-volume\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.196678 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.196658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rm8d\" (UniqueName: \"kubernetes.io/projected/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-api-access-5rm8d\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.336984 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.336885    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:48:11.337362 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.337346    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/0.log"
Sep 20 00:48:11.337401 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.337384    2568 generic.go:356] "Generic (PLEG): container finished" podID="c608f222-85e5-4d66-9612-43cda7de1b31" containerID="7398c6407e053dc9ab49571d6f067c93ed0f901995d55397dee924d6be67e473" exitCode=255
Sep 20 00:48:11.337516 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.337494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" event={"ID":"c608f222-85e5-4d66-9612-43cda7de1b31","Type":"ContainerDied","Data":"7398c6407e053dc9ab49571d6f067c93ed0f901995d55397dee924d6be67e473"}
Sep 20 00:48:11.337573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.337561    2568 scope.go:117] "RemoveContainer" containerID="534014e9c6b6d2a5d9183fb060d3c782b52ee85103940e9f917aeb737a2b11a4"
Sep 20 00:48:11.337688 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.337670    2568 scope.go:117] "RemoveContainer" containerID="7398c6407e053dc9ab49571d6f067c93ed0f901995d55397dee924d6be67e473"
Sep 20 00:48:11.338077 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.337842    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zb4cn_openshift-console-operator(c608f222-85e5-4d66-9612-43cda7de1b31)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" podUID="c608f222-85e5-4d66-9612-43cda7de1b31"
Sep 20 00:48:11.692693 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.692667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.692824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:11.692727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:11.692859 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.692819    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.692859 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.692836    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.692948 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.692898    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:12.692880001 +0000 UTC m=+48.942381800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.692948 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:11.692936    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:12.692908807 +0000 UTC m=+48.942410625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:12.346008 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:12.345981    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:48:12.346377 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:12.346284    2568 scope.go:117] "RemoveContainer" containerID="7398c6407e053dc9ab49571d6f067c93ed0f901995d55397dee924d6be67e473"
Sep 20 00:48:12.346457 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:12.346437    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zb4cn_openshift-console-operator(c608f222-85e5-4d66-9612-43cda7de1b31)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" podUID="c608f222-85e5-4d66-9612-43cda7de1b31"
Sep 20 00:48:12.701646 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:12.701612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:12.701797 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:12.701730    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:12.701797 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:12.701753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:12.701797 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:12.701795    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:14.701776839 +0000 UTC m=+50.951278641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:12.701948 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:12.701859    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:12.701948 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:12.701906    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:14.701893237 +0000 UTC m=+50.951395036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:12.800605 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:12.800579    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssbd8_5842520d-6796-4145-b3d2-ccc7bd40ea0e/dns-node-resolver/0.log"
Sep 20 00:48:13.806937 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:13.806895    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rxsh4_caa30d1a-b31f-4f19-9b7e-ae21ab457b0e/node-ca/0.log"
Sep 20 00:48:14.402318 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:14.402276    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwwdz_2a87d3b0-8e92-4273-a582-d734c67c8c18/serve-healthcheck-canary/0.log"
Sep 20 00:48:14.720649 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:14.720617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:14.720817 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:14.720685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:14.720817 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:14.720787    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:14.720946 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:14.720836    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:18.720822647 +0000 UTC m=+54.970324428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:14.720946 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:14.720787    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:14.720946 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:14.720935    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:18.720904227 +0000 UTC m=+54.970406009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:15.225209 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:15.225168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:15.225219    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:15.225240    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:15.225288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225321    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225358    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.225336525 +0000 UTC m=+67.474838336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : configmap references non-existent config key: service-ca.crt
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225410    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225417    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225432    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454f65595-lpv4b: secret "image-registry-tls" not found
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225443    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs podName:a5111e83-a1f2-4f30-9cd5-4e661710dfa6 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.225435643 +0000 UTC m=+67.474937425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs") pod "router-default-f877b5d76-g48vt" (UID: "a5111e83-a1f2-4f30-9cd5-4e661710dfa6") : secret "router-metrics-certs-default" not found
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225457    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls podName:658d8f90-8dda-48c4-82d7-397dfd77d262 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.225450343 +0000 UTC m=+67.474952125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcrb" (UID: "658d8f90-8dda-48c4-82d7-397dfd77d262") : secret "cluster-monitoring-operator-tls" not found
Sep 20 00:48:15.225592 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.225466    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls podName:b6030f81-6bcc-451d-9b7b-f9dfed272825 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.225461317 +0000 UTC m=+67.474963099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls") pod "image-registry-7454f65595-lpv4b" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825") : secret "image-registry-tls" not found
Sep 20 00:48:15.326266 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:15.326230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:15.326432 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.326379    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 20 00:48:15.326508 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.326448    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls podName:23e68ae5-bf8f-4f32-adc7-7446dd28494a nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.326431904 +0000 UTC m=+67.575933707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-qqhlg" (UID: "23e68ae5-bf8f-4f32-adc7-7446dd28494a") : secret "samples-operator-tls" not found
Sep 20 00:48:15.427144 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:15.427106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:15.427286 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.427240    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:15.427344 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:15.427294    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls podName:0cfec327-8405-465e-8afb-e10959dfe4be nodeName:}" failed. No retries permitted until 2026-09-20 00:48:31.427278605 +0000 UTC m=+67.676780387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls") pod "dns-default-6p6f6" (UID: "0cfec327-8405-465e-8afb-e10959dfe4be") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:18.753567 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:18.753532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:18.753955 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:18.753618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:18.753955 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:18.753702    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:18.753955 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:18.753766    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls podName:8f675bec-fcea-4e2c-a7fe-dfd286c1e166 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:26.753750464 +0000 UTC m=+63.003252253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lqmf" (UID: "8f675bec-fcea-4e2c-a7fe-dfd286c1e166") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:18.754169 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:18.754148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:19.762710 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:19.762673    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:48:19.763109 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:19.762731    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:48:19.763109 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:19.763074    2568 scope.go:117] "RemoveContainer" containerID="7398c6407e053dc9ab49571d6f067c93ed0f901995d55397dee924d6be67e473"
Sep 20 00:48:19.763231 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:48:19.763213    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zb4cn_openshift-console-operator(c608f222-85e5-4d66-9612-43cda7de1b31)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" podUID="c608f222-85e5-4d66-9612-43cda7de1b31"
Sep 20 00:48:25.235805 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:25.235776    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzzzj"
Sep 20 00:48:26.822322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:26.822276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:26.824509 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:26.824488    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f675bec-fcea-4e2c-a7fe-dfd286c1e166-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lqmf\" (UID: \"8f675bec-fcea-4e2c-a7fe-dfd286c1e166\") " pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:26.935252 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:26.935219    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzh76\""
Sep 20 00:48:26.943313 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:26.943289    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lqmf"
Sep 20 00:48:27.211676 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:27.211641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9lqmf"]
Sep 20 00:48:27.214688 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:27.214660    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f675bec_fcea_4e2c_a7fe_dfd286c1e166.slice/crio-56ce36cc8d1fd4233a4301e4137e719a81b3b459cc5365efb32e6752f5a5b0a6 WatchSource:0}: Error finding container 56ce36cc8d1fd4233a4301e4137e719a81b3b459cc5365efb32e6752f5a5b0a6: Status 404 returned error can't find the container with id 56ce36cc8d1fd4233a4301e4137e719a81b3b459cc5365efb32e6752f5a5b0a6
Sep 20 00:48:27.393851 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:27.393815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lqmf" event={"ID":"8f675bec-fcea-4e2c-a7fe-dfd286c1e166","Type":"ContainerStarted","Data":"4d594a226ade2b85a7396139966b89590d50fc19ef144c2febb73305f5830f5a"}
Sep 20 00:48:27.394033 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:27.393880    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lqmf" event={"ID":"8f675bec-fcea-4e2c-a7fe-dfd286c1e166","Type":"ContainerStarted","Data":"56ce36cc8d1fd4233a4301e4137e719a81b3b459cc5365efb32e6752f5a5b0a6"}
Sep 20 00:48:28.399792 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:28.399757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lqmf" event={"ID":"8f675bec-fcea-4e2c-a7fe-dfd286c1e166","Type":"ContainerStarted","Data":"004da70656636c363b1f65e8a48fd2ed53fe25adc73e7878d8fece07f100c585"}
Sep 20 00:48:29.405008 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:29.404912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lqmf" event={"ID":"8f675bec-fcea-4e2c-a7fe-dfd286c1e166","Type":"ContainerStarted","Data":"ded4020a1827b72074f433a5b395e16d85153a3b41de3a5cec23132a4a34a119"}
Sep 20 00:48:29.421462 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:29.421418    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9lqmf" podStartSLOduration=16.635867578 podStartE2EDuration="18.421402194s" totalImagesPullingTime="1.785534616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:48:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:29.420099072 +0000 UTC m=+65.669600876" watchObservedRunningTime="2026-09-20 00:48:29.421402194 +0000 UTC m=+65.670903998"
Sep 20 00:48:31.262167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.262111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:31.262167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.262175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:31.262713 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.262192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:31.262713 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.262230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:31.263003 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.262969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-service-ca-bundle\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:31.264909 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.264885    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5111e83-a1f2-4f30-9cd5-4e661710dfa6-metrics-certs\") pod \"router-default-f877b5d76-g48vt\" (UID: \"a5111e83-a1f2-4f30-9cd5-4e661710dfa6\") " pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:31.265020 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.264888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"image-registry-7454f65595-lpv4b\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") " pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:31.265020 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.265000    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/658d8f90-8dda-48c4-82d7-397dfd77d262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcrb\" (UID: \"658d8f90-8dda-48c4-82d7-397dfd77d262\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:31.363213 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.363173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:31.365614 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.365590    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/23e68ae5-bf8f-4f32-adc7-7446dd28494a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-qqhlg\" (UID: \"23e68ae5-bf8f-4f32-adc7-7446dd28494a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:31.445214 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.445179    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6rsk8\""
Sep 20 00:48:31.453927 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.453905    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:31.464139 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.464116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:31.466462 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.466439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfec327-8405-465e-8afb-e10959dfe4be-metrics-tls\") pod \"dns-default-6p6f6\" (UID: \"0cfec327-8405-465e-8afb-e10959dfe4be\") " pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:31.470133 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.470113    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g8fk6\""
Sep 20 00:48:31.478789 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.478771    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:31.500122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.500096    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lvrd6\""
Sep 20 00:48:31.509317 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.509255    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"
Sep 20 00:48:31.604658 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.604631    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5xhhs\""
Sep 20 00:48:31.612330 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.612314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"
Sep 20 00:48:31.643451 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.643425    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wd7tm\""
Sep 20 00:48:31.652015 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.651983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:31.728212 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.728188    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f877b5d76-g48vt"]
Sep 20 00:48:31.730262 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:31.730239    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5111e83_a1f2_4f30_9cd5_4e661710dfa6.slice/crio-10f7e3513fdb1aae6e9cb5cc4d0018ba75385c3451312530c393d198d48791fe WatchSource:0}: Error finding container 10f7e3513fdb1aae6e9cb5cc4d0018ba75385c3451312530c393d198d48791fe: Status 404 returned error can't find the container with id 10f7e3513fdb1aae6e9cb5cc4d0018ba75385c3451312530c393d198d48791fe
Sep 20 00:48:31.766331 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.766306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:48:31.769816 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.769763    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 00:48:31.772858 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.772833    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7454f65595-lpv4b"]
Sep 20 00:48:31.776424 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:31.776402    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6030f81_6bcc_451d_9b7b_f9dfed272825.slice/crio-2e7faf127a5f4af94ff92bd54a0d73ad028793eb84c3120e227923730e2a02ee WatchSource:0}: Error finding container 2e7faf127a5f4af94ff92bd54a0d73ad028793eb84c3120e227923730e2a02ee: Status 404 returned error can't find the container with id 2e7faf127a5f4af94ff92bd54a0d73ad028793eb84c3120e227923730e2a02ee
Sep 20 00:48:31.779540 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.779520    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca261dfa-0300-498b-9f0e-f21d394d8ee6-original-pull-secret\") pod \"global-pull-secret-syncer-n742d\" (UID: \"ca261dfa-0300-498b-9f0e-f21d394d8ee6\") " pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:48:31.797555 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.797534    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb"]
Sep 20 00:48:31.805978 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:31.805945    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658d8f90_8dda_48c4_82d7_397dfd77d262.slice/crio-f0e50398412032eb8c21221b7b4098af809a6efc6398f5d7e808ee634e4606fa WatchSource:0}: Error finding container f0e50398412032eb8c21221b7b4098af809a6efc6398f5d7e808ee634e4606fa: Status 404 returned error can't find the container with id f0e50398412032eb8c21221b7b4098af809a6efc6398f5d7e808ee634e4606fa
Sep 20 00:48:31.867379 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.867346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:48:31.869308 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.869287    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 00:48:31.876908 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.876888    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg"]
Sep 20 00:48:31.879987 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.879966    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafb2e84-f0f7-499d-a96f-8385327a0b63-metrics-certs\") pod \"network-metrics-daemon-nph9k\" (UID: \"bafb2e84-f0f7-499d-a96f-8385327a0b63\") " pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:48:31.912967 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.912937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n742d"
Sep 20 00:48:31.920521 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.920499    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkppn\""
Sep 20 00:48:31.923908 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.923828    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6p6f6"]
Sep 20 00:48:31.928114 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:31.928086    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfec327_8405_465e_8afb_e10959dfe4be.slice/crio-df614bd97f46dd28db45396c65bb89c1cc34308f758df33a76df165765b3c65a WatchSource:0}: Error finding container df614bd97f46dd28db45396c65bb89c1cc34308f758df33a76df165765b3c65a: Status 404 returned error can't find the container with id df614bd97f46dd28db45396c65bb89c1cc34308f758df33a76df165765b3c65a
Sep 20 00:48:31.928839 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.928808    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nph9k"
Sep 20 00:48:31.981464 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:31.981440    2568 scope.go:117] "RemoveContainer" containerID="7398c6407e053dc9ab49571d6f067c93ed0f901995d55397dee924d6be67e473"
Sep 20 00:48:32.200457 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.200424    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n742d"]
Sep 20 00:48:32.203949 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:32.203892    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca261dfa_0300_498b_9f0e_f21d394d8ee6.slice/crio-dfa5e6ab9a8abd58161eb021ee1bddd8284c686d15a67bc6451740cb30b8eb9a WatchSource:0}: Error finding container dfa5e6ab9a8abd58161eb021ee1bddd8284c686d15a67bc6451740cb30b8eb9a: Status 404 returned error can't find the container with id dfa5e6ab9a8abd58161eb021ee1bddd8284c686d15a67bc6451740cb30b8eb9a
Sep 20 00:48:32.225095 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.225065    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nph9k"]
Sep 20 00:48:32.229809 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:32.229770    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafb2e84_f0f7_499d_a96f_8385327a0b63.slice/crio-8c191fb45134b157ef39d9a869848d37609fabd0d7fa14d9cf027eab1952178d WatchSource:0}: Error finding container 8c191fb45134b157ef39d9a869848d37609fabd0d7fa14d9cf027eab1952178d: Status 404 returned error can't find the container with id 8c191fb45134b157ef39d9a869848d37609fabd0d7fa14d9cf027eab1952178d
Sep 20 00:48:32.418344 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.418264    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:48:32.418769 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.418354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" event={"ID":"c608f222-85e5-4d66-9612-43cda7de1b31","Type":"ContainerStarted","Data":"5c940fe16c77602cb2faa152f7880df348bfe86183dfc066e80a6440baa5e8bd"}
Sep 20 00:48:32.419024 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.418988    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:48:32.420733 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.420706    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg" event={"ID":"23e68ae5-bf8f-4f32-adc7-7446dd28494a","Type":"ContainerStarted","Data":"9805763923abcae3b09bc1f1e586c82ba85bfe2234c66aca2d99d18ffa596c71"}
Sep 20 00:48:32.422463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.422437    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f877b5d76-g48vt" event={"ID":"a5111e83-a1f2-4f30-9cd5-4e661710dfa6","Type":"ContainerStarted","Data":"34c67b635972d5443a58bc39f761ddfec8859700e5fd26906ad7f5ab29c37c3c"}
Sep 20 00:48:32.422582 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.422479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f877b5d76-g48vt" event={"ID":"a5111e83-a1f2-4f30-9cd5-4e661710dfa6","Type":"ContainerStarted","Data":"10f7e3513fdb1aae6e9cb5cc4d0018ba75385c3451312530c393d198d48791fe"}
Sep 20 00:48:32.423941 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.423892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n742d" event={"ID":"ca261dfa-0300-498b-9f0e-f21d394d8ee6","Type":"ContainerStarted","Data":"dfa5e6ab9a8abd58161eb021ee1bddd8284c686d15a67bc6451740cb30b8eb9a"}
Sep 20 00:48:32.425293 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.425270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb" event={"ID":"658d8f90-8dda-48c4-82d7-397dfd77d262","Type":"ContainerStarted","Data":"f0e50398412032eb8c21221b7b4098af809a6efc6398f5d7e808ee634e4606fa"}
Sep 20 00:48:32.426609 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.426584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nph9k" event={"ID":"bafb2e84-f0f7-499d-a96f-8385327a0b63","Type":"ContainerStarted","Data":"8c191fb45134b157ef39d9a869848d37609fabd0d7fa14d9cf027eab1952178d"}
Sep 20 00:48:32.427842 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.427820    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p6f6" event={"ID":"0cfec327-8405-465e-8afb-e10959dfe4be","Type":"ContainerStarted","Data":"df614bd97f46dd28db45396c65bb89c1cc34308f758df33a76df165765b3c65a"}
Sep 20 00:48:32.429557 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.429528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454f65595-lpv4b" event={"ID":"b6030f81-6bcc-451d-9b7b-f9dfed272825","Type":"ContainerStarted","Data":"93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841"}
Sep 20 00:48:32.429642 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.429567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454f65595-lpv4b" event={"ID":"b6030f81-6bcc-451d-9b7b-f9dfed272825","Type":"ContainerStarted","Data":"2e7faf127a5f4af94ff92bd54a0d73ad028793eb84c3120e227923730e2a02ee"}
Sep 20 00:48:32.429720 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.429658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:32.442345 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.442291    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn" podStartSLOduration=42.337712396 podStartE2EDuration="50.442273404s" totalImagesPullingTime="8.104561008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:32.441681173 +0000 UTC m=+68.691182977" watchObservedRunningTime="2026-09-20 00:48:32.442273404 +0000 UTC m=+68.691775210"
Sep 20 00:48:32.454869 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.454842    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:32.457594 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.457574    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:32.468658 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.468618    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f877b5d76-g48vt" podStartSLOduration=60.468605641 podStartE2EDuration="1m0.468605641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:32.467645001 +0000 UTC m=+68.717146806" watchObservedRunningTime="2026-09-20 00:48:32.468605641 +0000 UTC m=+68.718107445"
Sep 20 00:48:32.497849 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.497347    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7454f65595-lpv4b" podStartSLOduration=66.497277614 podStartE2EDuration="1m6.497277614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:32.495774562 +0000 UTC m=+68.745276370" watchObservedRunningTime="2026-09-20 00:48:32.497277614 +0000 UTC m=+68.746779419"
Sep 20 00:48:32.813379 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:32.813161    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-zb4cn"
Sep 20 00:48:33.437039 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:33.437003    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:33.438831 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:33.438795    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f877b5d76-g48vt"
Sep 20 00:48:37.453862 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.453823    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p6f6" event={"ID":"0cfec327-8405-465e-8afb-e10959dfe4be","Type":"ContainerStarted","Data":"a827d1029aa71d0be8fc00882718db72b6ab004123c28eeb92150765140458e8"}
Sep 20 00:48:37.454328 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.453926    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p6f6" event={"ID":"0cfec327-8405-465e-8afb-e10959dfe4be","Type":"ContainerStarted","Data":"4614861dc7c1b9d3d0295364923802714afd83d48b672547bb9e10a2b9726992"}
Sep 20 00:48:37.454328 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.453958    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:37.455825 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.455793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg" event={"ID":"23e68ae5-bf8f-4f32-adc7-7446dd28494a","Type":"ContainerStarted","Data":"7557302da97cad56fad33682e0453e16e12e2900c03b33b581de90d588cfa831"}
Sep 20 00:48:37.455993 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.455840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg" event={"ID":"23e68ae5-bf8f-4f32-adc7-7446dd28494a","Type":"ContainerStarted","Data":"66abae2d17656298547454481c5a2ea5e4e004c9e6d82f521db581632b4962b7"}
Sep 20 00:48:37.457288 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.457270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n742d" event={"ID":"ca261dfa-0300-498b-9f0e-f21d394d8ee6","Type":"ContainerStarted","Data":"d66b5b2bccf91d74e8656252c1fc40c983a7c4659e4394752d8fc2e520f1de5e"}
Sep 20 00:48:37.458673 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.458652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb" event={"ID":"658d8f90-8dda-48c4-82d7-397dfd77d262","Type":"ContainerStarted","Data":"786ccf01dee4c5adc3ce730bc0f3249c8ccd3b001256d258b91f35a1b71e8119"}
Sep 20 00:48:37.460472 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.460452    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nph9k" event={"ID":"bafb2e84-f0f7-499d-a96f-8385327a0b63","Type":"ContainerStarted","Data":"8e2d1c63c1ce02d8b20fc2212ccfdf380beb4fbb8ea16298c4ccf7cb9a626f92"}
Sep 20 00:48:37.460590 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.460487    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nph9k" event={"ID":"bafb2e84-f0f7-499d-a96f-8385327a0b63","Type":"ContainerStarted","Data":"42e0361a8760694080112fc151d1f2c8a84656a21ccd9d006ce8bc8dc4da6683"}
Sep 20 00:48:37.469843 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.469802    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6p6f6" podStartSLOduration=33.844353598 podStartE2EDuration="38.469789354s" totalImagesPullingTime="4.625435756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.468230428 +0000 UTC m=+73.717732231" watchObservedRunningTime="2026-09-20 00:48:37.469789354 +0000 UTC m=+73.719291158"
Sep 20 00:48:37.482505 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.482455    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nph9k" podStartSLOduration=68.520287223 podStartE2EDuration="1m11.482437053s" totalImagesPullingTime="2.96214983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.482125994 +0000 UTC m=+73.731627798" watchObservedRunningTime="2026-09-20 00:48:37.482437053 +0000 UTC m=+73.731938858"
Sep 20 00:48:37.496824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.496780    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcrb" podStartSLOduration=60.74875169 podStartE2EDuration="1m5.49676676s" totalImagesPullingTime="4.74801507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.496193358 +0000 UTC m=+73.745695163" watchObservedRunningTime="2026-09-20 00:48:37.49676676 +0000 UTC m=+73.746268563"
Sep 20 00:48:37.510164 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.510122    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-qqhlg" podStartSLOduration=52.239282645 podStartE2EDuration="55.510108737s" totalImagesPullingTime="3.270826092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.509549796 +0000 UTC m=+73.759051600" watchObservedRunningTime="2026-09-20 00:48:37.510108737 +0000 UTC m=+73.759610540"
Sep 20 00:48:37.528771 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:37.528732    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n742d" podStartSLOduration=67.1334687 podStartE2EDuration="1m11.528718192s" totalImagesPullingTime="4.395249492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.528041664 +0000 UTC m=+73.777543470" watchObservedRunningTime="2026-09-20 00:48:37.528718192 +0000 UTC m=+73.778219995"
Sep 20 00:48:41.339997 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:41.339870    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zfszg"
Sep 20 00:48:45.650993 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.650953    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wxmkl"]
Sep 20 00:48:45.654773 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.654745    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.657555 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.657531    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 20 00:48:45.657873 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.657832    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 20 00:48:45.658015 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.657932    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 20 00:48:45.658015 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.657994    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 20 00:48:45.658097 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.658048    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mwr4l\""
Sep 20 00:48:45.784694 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784657    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.784861 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784710    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-wtmp\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.784861 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.784861 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784825    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-textfile\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.784861 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa029d0-d6a2-439c-968f-93d3a154542d-metrics-client-ca\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.785043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784874    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-root\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.785043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dkp\" (UniqueName: \"kubernetes.io/projected/afa029d0-d6a2-439c-968f-93d3a154542d-kube-api-access-g4dkp\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.785043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784949    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-sys\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.785043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.784998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-tls\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886033 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.885998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-wtmp\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886210 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886210 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-textfile\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886210 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa029d0-d6a2-439c-968f-93d3a154542d-metrics-client-ca\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886210 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-root\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886210 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dkp\" (UniqueName: \"kubernetes.io/projected/afa029d0-d6a2-439c-968f-93d3a154542d-kube-api-access-g4dkp\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886210 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886187    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-wtmp\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886492 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886254    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-root\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886492 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-sys\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886492 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-tls\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886492 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886492 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afa029d0-d6a2-439c-968f-93d3a154542d-sys\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886744 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-textfile\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886876 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886855    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa029d0-d6a2-439c-968f-93d3a154542d-metrics-client-ca\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.886960 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.886895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.888502 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.888482    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.888967 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.888945    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afa029d0-d6a2-439c-968f-93d3a154542d-node-exporter-tls\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.892996 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.892978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dkp\" (UniqueName: \"kubernetes.io/projected/afa029d0-d6a2-439c-968f-93d3a154542d-kube-api-access-g4dkp\") pod \"node-exporter-wxmkl\" (UID: \"afa029d0-d6a2-439c-968f-93d3a154542d\") " pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.964342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:45.964300    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxmkl"
Sep 20 00:48:45.977459 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:45.977423    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa029d0_d6a2_439c_968f_93d3a154542d.slice/crio-2f5d14910a84474843627d0a38aa861298cc64519b1a6774464ed14a6327577e WatchSource:0}: Error finding container 2f5d14910a84474843627d0a38aa861298cc64519b1a6774464ed14a6327577e: Status 404 returned error can't find the container with id 2f5d14910a84474843627d0a38aa861298cc64519b1a6774464ed14a6327577e
Sep 20 00:48:46.495397 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:46.495356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxmkl" event={"ID":"afa029d0-d6a2-439c-968f-93d3a154542d","Type":"ContainerStarted","Data":"2f5d14910a84474843627d0a38aa861298cc64519b1a6774464ed14a6327577e"}
Sep 20 00:48:47.466475 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:47.466446    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6p6f6"
Sep 20 00:48:47.501417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:47.501388    2568 generic.go:356] "Generic (PLEG): container finished" podID="afa029d0-d6a2-439c-968f-93d3a154542d" containerID="9645992df89a01cc6246f5913bd19f469057f09a760772110ab44c6b613e8908" exitCode=0
Sep 20 00:48:47.501576 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:47.501452    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxmkl" event={"ID":"afa029d0-d6a2-439c-968f-93d3a154542d","Type":"ContainerDied","Data":"9645992df89a01cc6246f5913bd19f469057f09a760772110ab44c6b613e8908"}
Sep 20 00:48:48.506525 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:48.506490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxmkl" event={"ID":"afa029d0-d6a2-439c-968f-93d3a154542d","Type":"ContainerStarted","Data":"c2f817e948d57fe27eafa920d28d92b2ff13e440b7f19085d7fcdfefe16a948e"}
Sep 20 00:48:48.506876 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:48.506545    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxmkl" event={"ID":"afa029d0-d6a2-439c-968f-93d3a154542d","Type":"ContainerStarted","Data":"c94d39a6299794fcfe949393809abbd8ba8ac978bb5690d2ba8b1929864906ea"}
Sep 20 00:48:50.386322 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.386263    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wxmkl" podStartSLOduration=4.505518485 podStartE2EDuration="5.386241109s" totalImagesPullingTime="816.531661ms" totalInitContainerRuntime="64.190963ms" isStatefulPod=true podCreationTimestamp="2026-09-20 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:48.525468632 +0000 UTC m=+84.774970442" watchObservedRunningTime="2026-09-20 00:48:50.386241109 +0000 UTC m=+86.635742908"
Sep 20 00:48:50.387732 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.387704    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"]
Sep 20 00:48:50.389755 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.389736    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.391621 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.391599    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 20 00:48:50.391709 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.391685    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-phqfr\""
Sep 20 00:48:50.399437 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.399415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"]
Sep 20 00:48:50.524508 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.524476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m8l2\" (UniqueName: \"kubernetes.io/projected/1c6fca46-59dd-4dff-b84a-abfac77bcd4c-kube-api-access-8m8l2\") pod \"monitoring-plugin-5984459ff8-l97ls\" (UID: \"1c6fca46-59dd-4dff-b84a-abfac77bcd4c\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.524677 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.524519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c6fca46-59dd-4dff-b84a-abfac77bcd4c-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-l97ls\" (UID: \"1c6fca46-59dd-4dff-b84a-abfac77bcd4c\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.625682 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.625653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c6fca46-59dd-4dff-b84a-abfac77bcd4c-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-l97ls\" (UID: \"1c6fca46-59dd-4dff-b84a-abfac77bcd4c\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.625849 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.625713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8l2\" (UniqueName: \"kubernetes.io/projected/1c6fca46-59dd-4dff-b84a-abfac77bcd4c-kube-api-access-8m8l2\") pod \"monitoring-plugin-5984459ff8-l97ls\" (UID: \"1c6fca46-59dd-4dff-b84a-abfac77bcd4c\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.628092 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.628074    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c6fca46-59dd-4dff-b84a-abfac77bcd4c-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-l97ls\" (UID: \"1c6fca46-59dd-4dff-b84a-abfac77bcd4c\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.637361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.637307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m8l2\" (UniqueName: \"kubernetes.io/projected/1c6fca46-59dd-4dff-b84a-abfac77bcd4c-kube-api-access-8m8l2\") pod \"monitoring-plugin-5984459ff8-l97ls\" (UID: \"1c6fca46-59dd-4dff-b84a-abfac77bcd4c\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.698981 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.698951    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:50.968316 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:50.968286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"]
Sep 20 00:48:50.971321 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:48:50.971290    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6fca46_59dd_4dff_b84a_abfac77bcd4c.slice/crio-a3fab77a6c37f80963c9a8aeed2f58248bd70b350cc3177376002e96df3e3579 WatchSource:0}: Error finding container a3fab77a6c37f80963c9a8aeed2f58248bd70b350cc3177376002e96df3e3579: Status 404 returned error can't find the container with id a3fab77a6c37f80963c9a8aeed2f58248bd70b350cc3177376002e96df3e3579
Sep 20 00:48:51.519627 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:51.519587    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls" event={"ID":"1c6fca46-59dd-4dff-b84a-abfac77bcd4c","Type":"ContainerStarted","Data":"a3fab77a6c37f80963c9a8aeed2f58248bd70b350cc3177376002e96df3e3579"}
Sep 20 00:48:52.524824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:52.524745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls" event={"ID":"1c6fca46-59dd-4dff-b84a-abfac77bcd4c","Type":"ContainerStarted","Data":"4f8b744aace9d3b5985f33cdd5a0edc2bef6e809ec9922fa433be49e0a271d75"}
Sep 20 00:48:52.525226 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:52.524937    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:52.529781 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:52.529756    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls"
Sep 20 00:48:52.538857 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:52.538815    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-l97ls" podStartSLOduration=1.322784776 podStartE2EDuration="2.538800334s" totalImagesPullingTime="1.216015558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.537832262 +0000 UTC m=+88.787334060" watchObservedRunningTime="2026-09-20 00:48:52.538800334 +0000 UTC m=+88.788302139"
Sep 20 00:48:53.441235 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:53.441208    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:48:54.810658 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:48:54.810622    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7454f65595-lpv4b"]
Sep 20 00:49:19.829589 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:19.829526    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7454f65595-lpv4b" podUID="b6030f81-6bcc-451d-9b7b-f9dfed272825" containerName="registry" containerID="cri-o://93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841" gracePeriod=30
Sep 20 00:49:20.068234 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.068212    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:49:20.150623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150531    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-trusted-ca\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150597    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6030f81-6bcc-451d-9b7b-f9dfed272825-ca-trust-extracted\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150628    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlmtd\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-kube-api-access-dlmtd\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150654    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-installation-pull-secrets\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150684    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-bound-sa-token\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150717    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-certificates\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.150934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.150822    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-image-registry-private-configuration\") pod \"b6030f81-6bcc-451d-9b7b-f9dfed272825\" (UID: \"b6030f81-6bcc-451d-9b7b-f9dfed272825\") "
Sep 20 00:49:20.151190 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.151021    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:20.151386 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.151340    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:20.153731 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.153694    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:49:20.153731 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.153709    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:49:20.153871 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.153765    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:49:20.153871 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.153790    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:49:20.153871 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.153835    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-kube-api-access-dlmtd" (OuterVolumeSpecName: "kube-api-access-dlmtd") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "kube-api-access-dlmtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:49:20.159301 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.159278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6030f81-6bcc-451d-9b7b-f9dfed272825-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b6030f81-6bcc-451d-9b7b-f9dfed272825" (UID: "b6030f81-6bcc-451d-9b7b-f9dfed272825"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:49:20.251417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251385    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-certificates\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251411    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-registry-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251421    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-image-registry-private-configuration\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251615 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251430    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6030f81-6bcc-451d-9b7b-f9dfed272825-trusted-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251615 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251438    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6030f81-6bcc-451d-9b7b-f9dfed272825-ca-trust-extracted\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251615 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251446    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlmtd\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-kube-api-access-dlmtd\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251615 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251454    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6030f81-6bcc-451d-9b7b-f9dfed272825-installation-pull-secrets\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.251615 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.251462    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6030f81-6bcc-451d-9b7b-f9dfed272825-bound-sa-token\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.626479 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.626448    2568 generic.go:356] "Generic (PLEG): container finished" podID="b6030f81-6bcc-451d-9b7b-f9dfed272825" containerID="93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841" exitCode=0
Sep 20 00:49:20.626647 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.626495    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454f65595-lpv4b"
Sep 20 00:49:20.626647 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.626499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454f65595-lpv4b" event={"ID":"b6030f81-6bcc-451d-9b7b-f9dfed272825","Type":"ContainerDied","Data":"93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841"}
Sep 20 00:49:20.626647 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.626542    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454f65595-lpv4b" event={"ID":"b6030f81-6bcc-451d-9b7b-f9dfed272825","Type":"ContainerDied","Data":"2e7faf127a5f4af94ff92bd54a0d73ad028793eb84c3120e227923730e2a02ee"}
Sep 20 00:49:20.626647 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.626560    2568 scope.go:117] "RemoveContainer" containerID="93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841"
Sep 20 00:49:20.635064 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.635047    2568 scope.go:117] "RemoveContainer" containerID="93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841"
Sep 20 00:49:20.635361 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:49:20.635331    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841\": container with ID starting with 93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841 not found: ID does not exist" containerID="93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841"
Sep 20 00:49:20.635407 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.635370    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841"} err="failed to get container status \"93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841\": rpc error: code = NotFound desc = could not find container \"93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841\": container with ID starting with 93c2b520b8c208a0a8e3ec73203bcdb0cfc19371b2be803e52c6cacf72d0d841 not found: ID does not exist"
Sep 20 00:49:20.646074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.646052    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7454f65595-lpv4b"]
Sep 20 00:49:20.649821 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:20.649801    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7454f65595-lpv4b"]
Sep 20 00:49:21.985490 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:21.985458    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6030f81-6bcc-451d-9b7b-f9dfed272825" path="/var/lib/kubelet/pods/b6030f81-6bcc-451d-9b7b-f9dfed272825/volumes"
Sep 20 00:49:25.646314 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:25.646278    2568 generic.go:356] "Generic (PLEG): container finished" podID="1e37bb20-cc8d-43c8-9638-2546fc676ce4" containerID="bf7e2b24220b0c8238b1893ed932e8b09fc1adf348412791292aca1a6aacec96" exitCode=0
Sep 20 00:49:25.646723 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:25.646339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5" event={"ID":"1e37bb20-cc8d-43c8-9638-2546fc676ce4","Type":"ContainerDied","Data":"bf7e2b24220b0c8238b1893ed932e8b09fc1adf348412791292aca1a6aacec96"}
Sep 20 00:49:25.646723 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:25.646643    2568 scope.go:117] "RemoveContainer" containerID="bf7e2b24220b0c8238b1893ed932e8b09fc1adf348412791292aca1a6aacec96"
Sep 20 00:49:26.652336 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:26.652303    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-d6bg5" event={"ID":"1e37bb20-cc8d-43c8-9638-2546fc676ce4","Type":"ContainerStarted","Data":"0e2cd12d5644b114c39ec296a0bb893a73225d746037c6eb980aaa080b7c2e8f"}
Sep 20 00:49:40.704681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:40.704648    2568 generic.go:356] "Generic (PLEG): container finished" podID="de73791e-b2cd-4357-a667-0f5dfe3032fa" containerID="20e3549ea05ad0e681e5a089ef86750755e46edec135676b6d66127844dc8614" exitCode=0
Sep 20 00:49:40.705137 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:40.704724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx" event={"ID":"de73791e-b2cd-4357-a667-0f5dfe3032fa","Type":"ContainerDied","Data":"20e3549ea05ad0e681e5a089ef86750755e46edec135676b6d66127844dc8614"}
Sep 20 00:49:40.705137 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:40.705086    2568 scope.go:117] "RemoveContainer" containerID="20e3549ea05ad0e681e5a089ef86750755e46edec135676b6d66127844dc8614"
Sep 20 00:49:40.710634 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:40.706648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q" event={"ID":"5028ec9d-2e42-4ec0-be26-e9605573311d","Type":"ContainerDied","Data":"a23bf511ceb0567c197f1bd5027c4aef7a3db604b451af8b4a560ae4dc6b96ff"}
Sep 20 00:49:40.710634 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:40.706616    2568 generic.go:356] "Generic (PLEG): container finished" podID="5028ec9d-2e42-4ec0-be26-e9605573311d" containerID="a23bf511ceb0567c197f1bd5027c4aef7a3db604b451af8b4a560ae4dc6b96ff" exitCode=0
Sep 20 00:49:40.710634 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:40.707092    2568 scope.go:117] "RemoveContainer" containerID="a23bf511ceb0567c197f1bd5027c4aef7a3db604b451af8b4a560ae4dc6b96ff"
Sep 20 00:49:41.712651 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:41.712618    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4ptkx" event={"ID":"de73791e-b2cd-4357-a667-0f5dfe3032fa","Type":"ContainerStarted","Data":"d677c1ea6ba15c1d8f1067042761638f913c96e872494401bc7056d261d42304"}
Sep 20 00:49:41.714388 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:49:41.714360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rwn8q" event={"ID":"5028ec9d-2e42-4ec0-be26-e9605573311d","Type":"ContainerStarted","Data":"5ef336e295b61b78462f0c91e7de03f82b3aad9af468e32087813afca33e7a31"}
Sep 20 00:52:02.732996 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.732961    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"]
Sep 20 00:52:02.733421 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.733225    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6030f81-6bcc-451d-9b7b-f9dfed272825" containerName="registry"
Sep 20 00:52:02.733421 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.733235    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6030f81-6bcc-451d-9b7b-f9dfed272825" containerName="registry"
Sep 20 00:52:02.733421 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.733295    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6030f81-6bcc-451d-9b7b-f9dfed272825" containerName="registry"
Sep 20 00:52:02.736037 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.736019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.738791 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.738769    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 20 00:52:02.738904 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.738802    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 20 00:52:02.739093 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.739074    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 20 00:52:02.739144 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.739122    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 20 00:52:02.748574 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.748552    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"]
Sep 20 00:52:02.755501 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.755479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-tmp\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.755591 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.755509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.755591 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.755579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj82j\" (UniqueName: \"kubernetes.io/projected/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-kube-api-access-mj82j\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.855909 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.855876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj82j\" (UniqueName: \"kubernetes.io/projected/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-kube-api-access-mj82j\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.856102 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.855950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-tmp\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.856102 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.855975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.856358 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.856337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-tmp\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.858384 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.858367    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:02.864461 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:02.864440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj82j\" (UniqueName: \"kubernetes.io/projected/0e72ea9c-53d7-4f22-ba7d-465f25b9a25c-kube-api-access-mj82j\") pod \"klusterlet-addon-workmgr-5f4c5c6-ltgm2\" (UID: \"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:03.044765 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:03.044729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:03.309861 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:03.309766    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"]
Sep 20 00:52:03.312744 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:52:03.312718    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e72ea9c_53d7_4f22_ba7d_465f25b9a25c.slice/crio-d5e1aaab945c3abf6294164cb8bf8df9d12315c8883c1c78bfd88cc72d7b93d9 WatchSource:0}: Error finding container d5e1aaab945c3abf6294164cb8bf8df9d12315c8883c1c78bfd88cc72d7b93d9: Status 404 returned error can't find the container with id d5e1aaab945c3abf6294164cb8bf8df9d12315c8883c1c78bfd88cc72d7b93d9
Sep 20 00:52:04.209712 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:04.209679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2" event={"ID":"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c","Type":"ContainerStarted","Data":"d5e1aaab945c3abf6294164cb8bf8df9d12315c8883c1c78bfd88cc72d7b93d9"}
Sep 20 00:52:08.226484 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:08.226444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2" event={"ID":"0e72ea9c-53d7-4f22-ba7d-465f25b9a25c","Type":"ContainerStarted","Data":"82d681f0cd2a5938902a0632c9e151c56346fefcff5f5e541e99156a1d73e5f6"}
Sep 20 00:52:08.226945 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:08.226585    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:08.228256 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:08.228234    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2"
Sep 20 00:52:08.241516 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:08.241472    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f4c5c6-ltgm2" podStartSLOduration=2.048997736 podStartE2EDuration="6.241459307s" totalImagesPullingTime="4.192461571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:52:08.23980004 +0000 UTC m=+284.489301844" watchObservedRunningTime="2026-09-20 00:52:08.241459307 +0000 UTC m=+284.490961110"
Sep 20 00:52:25.926315 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:25.926282    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:52:25.933532 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:25.933506    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:52:25.942780 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:25.942753    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 20 00:52:58.203497 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.203467    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"]
Sep 20 00:52:58.205768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.205752    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.208056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.208036    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 20 00:52:58.208189 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.208172    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 20 00:52:58.208578 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.208560    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6pstm\""
Sep 20 00:52:58.214419 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.214396    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"]
Sep 20 00:52:58.293742 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.293711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.293901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.293764    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.293901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.293788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/51d1bb73-ebde-477c-904a-b88a8a80bff1-kube-api-access-tq6v2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.394786 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.394750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/51d1bb73-ebde-477c-904a-b88a8a80bff1-kube-api-access-tq6v2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.394957 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.394800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.394957 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.394843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.395166 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.395150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.395241 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.395221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.402857 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.402835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/51d1bb73-ebde-477c-904a-b88a8a80bff1-kube-api-access-tq6v2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.515488 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.515396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:52:58.781722 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.781698    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"]
Sep 20 00:52:58.784104 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:52:58.784082    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d1bb73_ebde_477c_904a_b88a8a80bff1.slice/crio-44a4cac4efda1602ab0ea673bff92199169462f9d666c068587eb549df774722 WatchSource:0}: Error finding container 44a4cac4efda1602ab0ea673bff92199169462f9d666c068587eb549df774722: Status 404 returned error can't find the container with id 44a4cac4efda1602ab0ea673bff92199169462f9d666c068587eb549df774722
Sep 20 00:52:58.786477 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:58.786450    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:52:59.414185 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:52:59.414149    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8" event={"ID":"51d1bb73-ebde-477c-904a-b88a8a80bff1","Type":"ContainerStarted","Data":"44a4cac4efda1602ab0ea673bff92199169462f9d666c068587eb549df774722"}
Sep 20 00:53:04.436634 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:04.436596    2568 generic.go:356] "Generic (PLEG): container finished" podID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerID="7380a21f797fe7c7ad6066527cde218317711a2fa62e74a24bb5e70f4cd43769" exitCode=0
Sep 20 00:53:04.436995 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:04.436682    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8" event={"ID":"51d1bb73-ebde-477c-904a-b88a8a80bff1","Type":"ContainerDied","Data":"7380a21f797fe7c7ad6066527cde218317711a2fa62e74a24bb5e70f4cd43769"}
Sep 20 00:53:06.446494 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:06.446468    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8" event={"ID":"51d1bb73-ebde-477c-904a-b88a8a80bff1","Type":"ContainerStarted","Data":"dc9cce574da23b2148d4f171763ae4bc455033819ccb3eb5d65e7ac9f2167283"}
Sep 20 00:53:07.452709 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:07.452671    2568 generic.go:356] "Generic (PLEG): container finished" podID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerID="dc9cce574da23b2148d4f171763ae4bc455033819ccb3eb5d65e7ac9f2167283" exitCode=0
Sep 20 00:53:07.453116 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:07.452715    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8" event={"ID":"51d1bb73-ebde-477c-904a-b88a8a80bff1","Type":"ContainerDied","Data":"dc9cce574da23b2148d4f171763ae4bc455033819ccb3eb5d65e7ac9f2167283"}
Sep 20 00:53:14.488896 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:14.488855    2568 generic.go:356] "Generic (PLEG): container finished" podID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerID="4e22167ca22699a77750799b22f5a6af21d1031194f8f3772717041c3b220ac9" exitCode=0
Sep 20 00:53:14.489340 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:14.488940    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8" event={"ID":"51d1bb73-ebde-477c-904a-b88a8a80bff1","Type":"ContainerDied","Data":"4e22167ca22699a77750799b22f5a6af21d1031194f8f3772717041c3b220ac9"}
Sep 20 00:53:15.615525 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.615499    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:53:15.731875 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.731847    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/51d1bb73-ebde-477c-904a-b88a8a80bff1-kube-api-access-tq6v2\") pod \"51d1bb73-ebde-477c-904a-b88a8a80bff1\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") "
Sep 20 00:53:15.732069 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.731888    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-util\") pod \"51d1bb73-ebde-477c-904a-b88a8a80bff1\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") "
Sep 20 00:53:15.732069 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.731959    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-bundle\") pod \"51d1bb73-ebde-477c-904a-b88a8a80bff1\" (UID: \"51d1bb73-ebde-477c-904a-b88a8a80bff1\") "
Sep 20 00:53:15.732642 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.732615    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-bundle" (OuterVolumeSpecName: "bundle") pod "51d1bb73-ebde-477c-904a-b88a8a80bff1" (UID: "51d1bb73-ebde-477c-904a-b88a8a80bff1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:53:15.734093 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.734059    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d1bb73-ebde-477c-904a-b88a8a80bff1-kube-api-access-tq6v2" (OuterVolumeSpecName: "kube-api-access-tq6v2") pod "51d1bb73-ebde-477c-904a-b88a8a80bff1" (UID: "51d1bb73-ebde-477c-904a-b88a8a80bff1"). InnerVolumeSpecName "kube-api-access-tq6v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:53:15.736228 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.736200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-util" (OuterVolumeSpecName: "util") pod "51d1bb73-ebde-477c-904a-b88a8a80bff1" (UID: "51d1bb73-ebde-477c-904a-b88a8a80bff1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:53:15.833093 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.833011    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/51d1bb73-ebde-477c-904a-b88a8a80bff1-kube-api-access-tq6v2\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:15.833093 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.833042    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:15.833093 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:15.833054    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51d1bb73-ebde-477c-904a-b88a8a80bff1-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:16.498142 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:16.498104    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8" event={"ID":"51d1bb73-ebde-477c-904a-b88a8a80bff1","Type":"ContainerDied","Data":"44a4cac4efda1602ab0ea673bff92199169462f9d666c068587eb549df774722"}
Sep 20 00:53:16.498313 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:16.498161    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44a4cac4efda1602ab0ea673bff92199169462f9d666c068587eb549df774722"
Sep 20 00:53:16.498313 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:16.498116    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwfb8"
Sep 20 00:53:21.118927 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.118883    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"]
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119152    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="util"
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119163    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="util"
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119171    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="pull"
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119177    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="pull"
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119189    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="extract"
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119195    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="extract"
Sep 20 00:53:21.119290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.119245    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d1bb73-ebde-477c-904a-b88a8a80bff1" containerName="extract"
Sep 20 00:53:21.149124 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.149097    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"]
Sep 20 00:53:21.149263 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.149185    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.151192 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.151167    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 20 00:53:21.151363 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.151210    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:53:21.151363 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.151225    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rljzm\""
Sep 20 00:53:21.274353 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.274315    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74ff98e5-c3f0-4fc4-9987-56c766e113f1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hkg69\" (UID: \"74ff98e5-c3f0-4fc4-9987-56c766e113f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.274520 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.274388    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7h4v\" (UniqueName: \"kubernetes.io/projected/74ff98e5-c3f0-4fc4-9987-56c766e113f1-kube-api-access-c7h4v\") pod \"cert-manager-operator-controller-manager-55c444bf86-hkg69\" (UID: \"74ff98e5-c3f0-4fc4-9987-56c766e113f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.375558 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.375479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74ff98e5-c3f0-4fc4-9987-56c766e113f1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hkg69\" (UID: \"74ff98e5-c3f0-4fc4-9987-56c766e113f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.375558 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.375544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7h4v\" (UniqueName: \"kubernetes.io/projected/74ff98e5-c3f0-4fc4-9987-56c766e113f1-kube-api-access-c7h4v\") pod \"cert-manager-operator-controller-manager-55c444bf86-hkg69\" (UID: \"74ff98e5-c3f0-4fc4-9987-56c766e113f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.375858 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.375839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74ff98e5-c3f0-4fc4-9987-56c766e113f1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hkg69\" (UID: \"74ff98e5-c3f0-4fc4-9987-56c766e113f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.384869 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.384841    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7h4v\" (UniqueName: \"kubernetes.io/projected/74ff98e5-c3f0-4fc4-9987-56c766e113f1-kube-api-access-c7h4v\") pod \"cert-manager-operator-controller-manager-55c444bf86-hkg69\" (UID: \"74ff98e5-c3f0-4fc4-9987-56c766e113f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.458549 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.458527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"
Sep 20 00:53:21.743535 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:21.743512    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69"]
Sep 20 00:53:21.745324 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:53:21.745292    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ff98e5_c3f0_4fc4_9987_56c766e113f1.slice/crio-26b3f723b6646e0ffc92e54b6f2d82867831ba53605d9157e66e8039e4c45528 WatchSource:0}: Error finding container 26b3f723b6646e0ffc92e54b6f2d82867831ba53605d9157e66e8039e4c45528: Status 404 returned error can't find the container with id 26b3f723b6646e0ffc92e54b6f2d82867831ba53605d9157e66e8039e4c45528
Sep 20 00:53:22.523845 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:22.523802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69" event={"ID":"74ff98e5-c3f0-4fc4-9987-56c766e113f1","Type":"ContainerStarted","Data":"26b3f723b6646e0ffc92e54b6f2d82867831ba53605d9157e66e8039e4c45528"}
Sep 20 00:53:24.539994 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:24.539953    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69" event={"ID":"74ff98e5-c3f0-4fc4-9987-56c766e113f1","Type":"ContainerStarted","Data":"40bad57faa1c697a69d96d14e453e303fdfaddc74dea4a3339a11863cfbb35c1"}
Sep 20 00:53:24.563138 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:24.563048    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hkg69" podStartSLOduration=1.5358019870000001 podStartE2EDuration="3.563028829s" totalImagesPullingTime="2.027226842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:53:24.559901638 +0000 UTC m=+360.809403442" watchObservedRunningTime="2026-09-20 00:53:24.563028829 +0000 UTC m=+360.812530629"
Sep 20 00:53:25.432486 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.432451    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"]
Sep 20 00:53:25.453532 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.453497    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"]
Sep 20 00:53:25.453681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.453616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.456177 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.456155    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 20 00:53:25.456302 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.456157    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 20 00:53:25.456641 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.456625    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6pstm\""
Sep 20 00:53:25.508671 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.508644    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.508785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.508683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpfg\" (UniqueName: \"kubernetes.io/projected/df509cf4-5a49-4487-84aa-2a4b92c69b00-kube-api-access-sfpfg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.508785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.508714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.609413 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.609384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.609782 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.609437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpfg\" (UniqueName: \"kubernetes.io/projected/df509cf4-5a49-4487-84aa-2a4b92c69b00-kube-api-access-sfpfg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.609782 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.609469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.609876 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.609820    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.609876 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.609827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.614112 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.614091    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ftmhw"]
Sep 20 00:53:25.619271 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.619249    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpfg\" (UniqueName: \"kubernetes.io/projected/df509cf4-5a49-4487-84aa-2a4b92c69b00-kube-api-access-sfpfg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.629663 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.629644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ftmhw"]
Sep 20 00:53:25.629755 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.629729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.632170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.632151    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xjc7v\""
Sep 20 00:53:25.632265 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.632155    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 20 00:53:25.632265 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.632212    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 20 00:53:25.710502 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.710423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdnmp\" (UniqueName: \"kubernetes.io/projected/f8c1af6f-5d82-4f8d-a3e5-4136047dce50-kube-api-access-qdnmp\") pod \"cert-manager-webhook-6486ffd997-ftmhw\" (UID: \"f8c1af6f-5d82-4f8d-a3e5-4136047dce50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.710626 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.710527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8c1af6f-5d82-4f8d-a3e5-4136047dce50-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ftmhw\" (UID: \"f8c1af6f-5d82-4f8d-a3e5-4136047dce50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.762463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.762432    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:25.811451 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.811417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdnmp\" (UniqueName: \"kubernetes.io/projected/f8c1af6f-5d82-4f8d-a3e5-4136047dce50-kube-api-access-qdnmp\") pod \"cert-manager-webhook-6486ffd997-ftmhw\" (UID: \"f8c1af6f-5d82-4f8d-a3e5-4136047dce50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.811623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.811512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8c1af6f-5d82-4f8d-a3e5-4136047dce50-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ftmhw\" (UID: \"f8c1af6f-5d82-4f8d-a3e5-4136047dce50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.819688 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.819654    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdnmp\" (UniqueName: \"kubernetes.io/projected/f8c1af6f-5d82-4f8d-a3e5-4136047dce50-kube-api-access-qdnmp\") pod \"cert-manager-webhook-6486ffd997-ftmhw\" (UID: \"f8c1af6f-5d82-4f8d-a3e5-4136047dce50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.819799 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.819736    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8c1af6f-5d82-4f8d-a3e5-4136047dce50-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ftmhw\" (UID: \"f8c1af6f-5d82-4f8d-a3e5-4136047dce50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:25.947997 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.947968    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xjc7v\""
Sep 20 00:53:25.956369 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:25.956348    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:26.048994 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:26.048844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"]
Sep 20 00:53:26.051654 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:53:26.051627    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf509cf4_5a49_4487_84aa_2a4b92c69b00.slice/crio-2c7ffa9160cfdc919f8dd1a98e472370600cd15b5ff05e98107d2e4abb75859c WatchSource:0}: Error finding container 2c7ffa9160cfdc919f8dd1a98e472370600cd15b5ff05e98107d2e4abb75859c: Status 404 returned error can't find the container with id 2c7ffa9160cfdc919f8dd1a98e472370600cd15b5ff05e98107d2e4abb75859c
Sep 20 00:53:26.257563 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:26.257538    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ftmhw"]
Sep 20 00:53:26.277738 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:53:26.277705    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8c1af6f_5d82_4f8d_a3e5_4136047dce50.slice/crio-aa7a2c3f6630af960db747789d34413c9a141b8626395878efddcccfd4d9c90e WatchSource:0}: Error finding container aa7a2c3f6630af960db747789d34413c9a141b8626395878efddcccfd4d9c90e: Status 404 returned error can't find the container with id aa7a2c3f6630af960db747789d34413c9a141b8626395878efddcccfd4d9c90e
Sep 20 00:53:26.548970 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:26.548864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw" event={"ID":"f8c1af6f-5d82-4f8d-a3e5-4136047dce50","Type":"ContainerStarted","Data":"aa7a2c3f6630af960db747789d34413c9a141b8626395878efddcccfd4d9c90e"}
Sep 20 00:53:26.550397 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:26.550365    2568 generic.go:356] "Generic (PLEG): container finished" podID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerID="03a363ad8e5f1a1af236ba1f942e295aac4d0e1bfcb70f695f49bf68e93585c9" exitCode=0
Sep 20 00:53:26.550519 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:26.550425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z" event={"ID":"df509cf4-5a49-4487-84aa-2a4b92c69b00","Type":"ContainerDied","Data":"03a363ad8e5f1a1af236ba1f942e295aac4d0e1bfcb70f695f49bf68e93585c9"}
Sep 20 00:53:26.550519 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:26.550463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z" event={"ID":"df509cf4-5a49-4487-84aa-2a4b92c69b00","Type":"ContainerStarted","Data":"2c7ffa9160cfdc919f8dd1a98e472370600cd15b5ff05e98107d2e4abb75859c"}
Sep 20 00:53:27.257594 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.257563    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"]
Sep 20 00:53:27.280381 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.280348    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"]
Sep 20 00:53:27.280545 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.280458    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.282616 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.282591    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tqmzn\""
Sep 20 00:53:27.325293 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.325257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52e5350b-bcc4-429b-8f57-615af705e79c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbc4t\" (UID: \"52e5350b-bcc4-429b-8f57-615af705e79c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.325481 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.325352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvcg\" (UniqueName: \"kubernetes.io/projected/52e5350b-bcc4-429b-8f57-615af705e79c-kube-api-access-mcvcg\") pod \"cert-manager-cainjector-559cdd8c87-tbc4t\" (UID: \"52e5350b-bcc4-429b-8f57-615af705e79c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.426644 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.426605    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvcg\" (UniqueName: \"kubernetes.io/projected/52e5350b-bcc4-429b-8f57-615af705e79c-kube-api-access-mcvcg\") pod \"cert-manager-cainjector-559cdd8c87-tbc4t\" (UID: \"52e5350b-bcc4-429b-8f57-615af705e79c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.426814 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.426695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52e5350b-bcc4-429b-8f57-615af705e79c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbc4t\" (UID: \"52e5350b-bcc4-429b-8f57-615af705e79c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.434875 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.434828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52e5350b-bcc4-429b-8f57-615af705e79c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbc4t\" (UID: \"52e5350b-bcc4-429b-8f57-615af705e79c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.435155 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.435126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvcg\" (UniqueName: \"kubernetes.io/projected/52e5350b-bcc4-429b-8f57-615af705e79c-kube-api-access-mcvcg\") pod \"cert-manager-cainjector-559cdd8c87-tbc4t\" (UID: \"52e5350b-bcc4-429b-8f57-615af705e79c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.592595 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.592517    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"
Sep 20 00:53:27.886063 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:27.885975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t"]
Sep 20 00:53:27.889793 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:53:27.889764    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52e5350b_bcc4_429b_8f57_615af705e79c.slice/crio-515361673bd7848df447d538bd5d97c505d5e856131239370e069e512857575a WatchSource:0}: Error finding container 515361673bd7848df447d538bd5d97c505d5e856131239370e069e512857575a: Status 404 returned error can't find the container with id 515361673bd7848df447d538bd5d97c505d5e856131239370e069e512857575a
Sep 20 00:53:28.562833 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:28.562780    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t" event={"ID":"52e5350b-bcc4-429b-8f57-615af705e79c","Type":"ContainerStarted","Data":"515361673bd7848df447d538bd5d97c505d5e856131239370e069e512857575a"}
Sep 20 00:53:30.573543 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.573506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t" event={"ID":"52e5350b-bcc4-429b-8f57-615af705e79c","Type":"ContainerStarted","Data":"db498a86cfcd86e899362b62ceafd8262de4f2b17f5b72e5067f57215beab11b"}
Sep 20 00:53:30.575075 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.575049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw" event={"ID":"f8c1af6f-5d82-4f8d-a3e5-4136047dce50","Type":"ContainerStarted","Data":"82c0fec7650b811b71a99aa637a009c947999d88748a5ebac762b46f2b8a4e0a"}
Sep 20 00:53:30.575221 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.575110    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:30.576988 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.576966    2568 generic.go:356] "Generic (PLEG): container finished" podID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerID="37d681fb584c286e56e452c04ab42aee8d93618fe6552e2058122bb60573796b" exitCode=0
Sep 20 00:53:30.577081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.577009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z" event={"ID":"df509cf4-5a49-4487-84aa-2a4b92c69b00","Type":"ContainerDied","Data":"37d681fb584c286e56e452c04ab42aee8d93618fe6552e2058122bb60573796b"}
Sep 20 00:53:30.588311 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.588261    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbc4t" podStartSLOduration=1.6121880210000001 podStartE2EDuration="3.588241995s" totalImagesPullingTime="1.976053974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:53:30.586749918 +0000 UTC m=+366.836251722" watchObservedRunningTime="2026-09-20 00:53:30.588241995 +0000 UTC m=+366.837743799"
Sep 20 00:53:30.618126 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:30.618075    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw" podStartSLOduration=2.029640598 podStartE2EDuration="5.618058839s" totalImagesPullingTime="3.588418241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:53:30.616884564 +0000 UTC m=+366.866386370" watchObservedRunningTime="2026-09-20 00:53:30.618058839 +0000 UTC m=+366.867560642"
Sep 20 00:53:31.583843 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:31.583808    2568 generic.go:356] "Generic (PLEG): container finished" podID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerID="0aa6a55bff1e240c43667e747ee98981a34a2c0d63616840ca63a754cb6cf805" exitCode=0
Sep 20 00:53:31.584253 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:31.583897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z" event={"ID":"df509cf4-5a49-4487-84aa-2a4b92c69b00","Type":"ContainerDied","Data":"0aa6a55bff1e240c43667e747ee98981a34a2c0d63616840ca63a754cb6cf805"}
Sep 20 00:53:32.709547 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.709520    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:32.772617 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.772582    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-util\") pod \"df509cf4-5a49-4487-84aa-2a4b92c69b00\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") "
Sep 20 00:53:32.772777 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.772630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfpfg\" (UniqueName: \"kubernetes.io/projected/df509cf4-5a49-4487-84aa-2a4b92c69b00-kube-api-access-sfpfg\") pod \"df509cf4-5a49-4487-84aa-2a4b92c69b00\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") "
Sep 20 00:53:32.772777 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.772691    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-bundle\") pod \"df509cf4-5a49-4487-84aa-2a4b92c69b00\" (UID: \"df509cf4-5a49-4487-84aa-2a4b92c69b00\") "
Sep 20 00:53:32.773188 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.773160    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-bundle" (OuterVolumeSpecName: "bundle") pod "df509cf4-5a49-4487-84aa-2a4b92c69b00" (UID: "df509cf4-5a49-4487-84aa-2a4b92c69b00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:53:32.774786 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.774767    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df509cf4-5a49-4487-84aa-2a4b92c69b00-kube-api-access-sfpfg" (OuterVolumeSpecName: "kube-api-access-sfpfg") pod "df509cf4-5a49-4487-84aa-2a4b92c69b00" (UID: "df509cf4-5a49-4487-84aa-2a4b92c69b00"). InnerVolumeSpecName "kube-api-access-sfpfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:53:32.777143 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.777109    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-util" (OuterVolumeSpecName: "util") pod "df509cf4-5a49-4487-84aa-2a4b92c69b00" (UID: "df509cf4-5a49-4487-84aa-2a4b92c69b00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:53:32.873595 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.873509    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:32.873595 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.873539    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df509cf4-5a49-4487-84aa-2a4b92c69b00-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:32.873595 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:32.873549    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfpfg\" (UniqueName: \"kubernetes.io/projected/df509cf4-5a49-4487-84aa-2a4b92c69b00-kube-api-access-sfpfg\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:33.596792 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:33.596757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z" event={"ID":"df509cf4-5a49-4487-84aa-2a4b92c69b00","Type":"ContainerDied","Data":"2c7ffa9160cfdc919f8dd1a98e472370600cd15b5ff05e98107d2e4abb75859c"}
Sep 20 00:53:33.596792 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:33.596787    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcx4z"
Sep 20 00:53:33.597042 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:33.596809    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c7ffa9160cfdc919f8dd1a98e472370600cd15b5ff05e98107d2e4abb75859c"
Sep 20 00:53:36.586838 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:36.586805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ftmhw"
Sep 20 00:53:45.500452 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500414    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"]
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500696    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="pull"
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500709    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="pull"
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500722    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="util"
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500728    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="util"
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500742    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="extract"
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500748    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="extract"
Sep 20 00:53:45.500811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.500803    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="df509cf4-5a49-4487-84aa-2a4b92c69b00" containerName="extract"
Sep 20 00:53:45.502953 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.502937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.505129 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.505107    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6pstm\""
Sep 20 00:53:45.505228 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.505109    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 20 00:53:45.505785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.505767    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 20 00:53:45.511400 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.511375    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"]
Sep 20 00:53:45.579570 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.579541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.579725 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.579582    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.579725 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.579644    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlgq9\" (UniqueName: \"kubernetes.io/projected/995a392c-b26c-44f5-9bae-22620b38e718-kube-api-access-xlgq9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.680066 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.680032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.680229 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.680078    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.680229 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.680125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlgq9\" (UniqueName: \"kubernetes.io/projected/995a392c-b26c-44f5-9bae-22620b38e718-kube-api-access-xlgq9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.680512 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.680490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.680551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.680511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.688487 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.688460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlgq9\" (UniqueName: \"kubernetes.io/projected/995a392c-b26c-44f5-9bae-22620b38e718-kube-api-access-xlgq9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:45.813606 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:45.813509    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:46.086869 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:46.084372    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"]
Sep 20 00:53:46.089945 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:53:46.089897    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995a392c_b26c_44f5_9bae_22620b38e718.slice/crio-d74a8f96e0e674482d06d76726cd981015bb5144ad75fc59895e111fac8cd66b WatchSource:0}: Error finding container d74a8f96e0e674482d06d76726cd981015bb5144ad75fc59895e111fac8cd66b: Status 404 returned error can't find the container with id d74a8f96e0e674482d06d76726cd981015bb5144ad75fc59895e111fac8cd66b
Sep 20 00:53:46.651985 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:46.651949    2568 generic.go:356] "Generic (PLEG): container finished" podID="995a392c-b26c-44f5-9bae-22620b38e718" containerID="b493255e59d3159a778ab8bedf97020557e0ca5ccae2ea00111d3078a0709047" exitCode=0
Sep 20 00:53:46.652324 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:46.652040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9" event={"ID":"995a392c-b26c-44f5-9bae-22620b38e718","Type":"ContainerDied","Data":"b493255e59d3159a778ab8bedf97020557e0ca5ccae2ea00111d3078a0709047"}
Sep 20 00:53:46.652324 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:46.652100    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9" event={"ID":"995a392c-b26c-44f5-9bae-22620b38e718","Type":"ContainerStarted","Data":"d74a8f96e0e674482d06d76726cd981015bb5144ad75fc59895e111fac8cd66b"}
Sep 20 00:53:47.658021 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:47.657934    2568 generic.go:356] "Generic (PLEG): container finished" podID="995a392c-b26c-44f5-9bae-22620b38e718" containerID="30688ffb57f82051efce4e2cad50f197c1100d37b227f24427241e4697b1cbcd" exitCode=0
Sep 20 00:53:47.658379 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:47.658009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9" event={"ID":"995a392c-b26c-44f5-9bae-22620b38e718","Type":"ContainerDied","Data":"30688ffb57f82051efce4e2cad50f197c1100d37b227f24427241e4697b1cbcd"}
Sep 20 00:53:48.664348 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:48.664315    2568 generic.go:356] "Generic (PLEG): container finished" podID="995a392c-b26c-44f5-9bae-22620b38e718" containerID="4822112c8b59b0716f064eb0c9d184a6e6060ef64a6c4a95a434b3e55e949c35" exitCode=0
Sep 20 00:53:48.664785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:48.664389    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9" event={"ID":"995a392c-b26c-44f5-9bae-22620b38e718","Type":"ContainerDied","Data":"4822112c8b59b0716f064eb0c9d184a6e6060ef64a6c4a95a434b3e55e949c35"}
Sep 20 00:53:49.791586 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.791563    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:49.913830 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.913799    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-bundle\") pod \"995a392c-b26c-44f5-9bae-22620b38e718\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") "
Sep 20 00:53:49.913830 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.913835    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-util\") pod \"995a392c-b26c-44f5-9bae-22620b38e718\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") "
Sep 20 00:53:49.914041 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.913875    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlgq9\" (UniqueName: \"kubernetes.io/projected/995a392c-b26c-44f5-9bae-22620b38e718-kube-api-access-xlgq9\") pod \"995a392c-b26c-44f5-9bae-22620b38e718\" (UID: \"995a392c-b26c-44f5-9bae-22620b38e718\") "
Sep 20 00:53:49.914522 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.914493    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-bundle" (OuterVolumeSpecName: "bundle") pod "995a392c-b26c-44f5-9bae-22620b38e718" (UID: "995a392c-b26c-44f5-9bae-22620b38e718"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:53:49.915895 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.915861    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995a392c-b26c-44f5-9bae-22620b38e718-kube-api-access-xlgq9" (OuterVolumeSpecName: "kube-api-access-xlgq9") pod "995a392c-b26c-44f5-9bae-22620b38e718" (UID: "995a392c-b26c-44f5-9bae-22620b38e718"). InnerVolumeSpecName "kube-api-access-xlgq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:53:49.919905 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:49.919813    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-util" (OuterVolumeSpecName: "util") pod "995a392c-b26c-44f5-9bae-22620b38e718" (UID: "995a392c-b26c-44f5-9bae-22620b38e718"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:53:50.015227 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:50.015192    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlgq9\" (UniqueName: \"kubernetes.io/projected/995a392c-b26c-44f5-9bae-22620b38e718-kube-api-access-xlgq9\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:50.015227 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:50.015221    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:50.015409 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:50.015233    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/995a392c-b26c-44f5-9bae-22620b38e718-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:53:50.675281 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:50.675252    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9"
Sep 20 00:53:50.675434 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:50.675283    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcwrb9" event={"ID":"995a392c-b26c-44f5-9bae-22620b38e718","Type":"ContainerDied","Data":"d74a8f96e0e674482d06d76726cd981015bb5144ad75fc59895e111fac8cd66b"}
Sep 20 00:53:50.675434 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:53:50.675324    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d74a8f96e0e674482d06d76726cd981015bb5144ad75fc59895e111fac8cd66b"
Sep 20 00:54:02.182072 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182036    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"]
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182329    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="extract"
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182339    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="extract"
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182350    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="util"
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182356    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="util"
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182362    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="pull"
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182367    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="pull"
Sep 20 00:54:02.182539 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.182420    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="995a392c-b26c-44f5-9bae-22620b38e718" containerName="extract"
Sep 20 00:54:02.186683 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.186664    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.190172 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.190143    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 20 00:54:02.190368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.190336    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 20 00:54:02.190533 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.190514    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 20 00:54:02.190791 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.190769    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wtnkv\""
Sep 20 00:54:02.190905 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.190821    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 20 00:54:02.209340 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.209314    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"]
Sep 20 00:54:02.313821 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.313789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c869858f-8d52-43b0-8241-3d5d4ca0a759-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.314007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.313834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c869858f-8d52-43b0-8241-3d5d4ca0a759-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.314007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.313877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c869858f-8d52-43b0-8241-3d5d4ca0a759-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.314007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.313911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c869858f-8d52-43b0-8241-3d5d4ca0a759-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.314007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.313958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d8mk\" (UniqueName: \"kubernetes.io/projected/c869858f-8d52-43b0-8241-3d5d4ca0a759-kube-api-access-5d8mk\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.414570 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.414537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c869858f-8d52-43b0-8241-3d5d4ca0a759-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.414570 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.414573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d8mk\" (UniqueName: \"kubernetes.io/projected/c869858f-8d52-43b0-8241-3d5d4ca0a759-kube-api-access-5d8mk\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.414778 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.414615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c869858f-8d52-43b0-8241-3d5d4ca0a759-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.414778 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.414641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c869858f-8d52-43b0-8241-3d5d4ca0a759-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.414778 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.414668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c869858f-8d52-43b0-8241-3d5d4ca0a759-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.414994 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.414972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c869858f-8d52-43b0-8241-3d5d4ca0a759-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.417036 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.417009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c869858f-8d52-43b0-8241-3d5d4ca0a759-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.417171 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.417043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c869858f-8d52-43b0-8241-3d5d4ca0a759-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.417171 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.417156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c869858f-8d52-43b0-8241-3d5d4ca0a759-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.423123 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.423102    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d8mk\" (UniqueName: \"kubernetes.io/projected/c869858f-8d52-43b0-8241-3d5d4ca0a759-kube-api-access-5d8mk\") pod \"opendatahub-operator-controller-manager-99bfbc77d-4lltx\" (UID: \"c869858f-8d52-43b0-8241-3d5d4ca0a759\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.497498 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.497416    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:02.646999 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.646967    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"]
Sep 20 00:54:02.649275 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.649259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.651258 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.651232    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 20 00:54:02.651444 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.651339    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6pstm\""
Sep 20 00:54:02.651444 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.651370    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 20 00:54:02.661201 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.661172    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"]
Sep 20 00:54:02.717935 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.717889    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfkvv\" (UniqueName: \"kubernetes.io/projected/2c69181c-3c67-4bff-aec3-771680368b9e-kube-api-access-gfkvv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.718094 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.717957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.718094 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.717982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.775331 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.775240    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"]
Sep 20 00:54:02.777775 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:54:02.777744    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc869858f_8d52_43b0_8241_3d5d4ca0a759.slice/crio-1f1cdc30448c5034a67da2b1607926d66e9d0da3d92b4c07da1cc1a45672e3a1 WatchSource:0}: Error finding container 1f1cdc30448c5034a67da2b1607926d66e9d0da3d92b4c07da1cc1a45672e3a1: Status 404 returned error can't find the container with id 1f1cdc30448c5034a67da2b1607926d66e9d0da3d92b4c07da1cc1a45672e3a1
Sep 20 00:54:02.818397 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.818366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfkvv\" (UniqueName: \"kubernetes.io/projected/2c69181c-3c67-4bff-aec3-771680368b9e-kube-api-access-gfkvv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.818551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.818405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.818551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.818430    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.818822 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.818801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.818863 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.818812    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.826155 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.826128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfkvv\" (UniqueName: \"kubernetes.io/projected/2c69181c-3c67-4bff-aec3-771680368b9e-kube-api-access-gfkvv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:02.958578 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:02.958539    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:03.232597 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:03.232499    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"]
Sep 20 00:54:03.234946 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:54:03.234895    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c69181c_3c67_4bff_aec3_771680368b9e.slice/crio-13906e7f4270ba6c642004f39276e0bbd661119a237bc6c13430a4269093109d WatchSource:0}: Error finding container 13906e7f4270ba6c642004f39276e0bbd661119a237bc6c13430a4269093109d: Status 404 returned error can't find the container with id 13906e7f4270ba6c642004f39276e0bbd661119a237bc6c13430a4269093109d
Sep 20 00:54:03.732699 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:03.732662    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c69181c-3c67-4bff-aec3-771680368b9e" containerID="1f3b98d1d69813083cf4ad852a19e9198c99ffe76c29ff6d41e5efadf2247e3b" exitCode=0
Sep 20 00:54:03.732901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:03.732745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p" event={"ID":"2c69181c-3c67-4bff-aec3-771680368b9e","Type":"ContainerDied","Data":"1f3b98d1d69813083cf4ad852a19e9198c99ffe76c29ff6d41e5efadf2247e3b"}
Sep 20 00:54:03.732901 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:03.732807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p" event={"ID":"2c69181c-3c67-4bff-aec3-771680368b9e","Type":"ContainerStarted","Data":"13906e7f4270ba6c642004f39276e0bbd661119a237bc6c13430a4269093109d"}
Sep 20 00:54:03.736249 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:03.736218    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx" event={"ID":"c869858f-8d52-43b0-8241-3d5d4ca0a759","Type":"ContainerStarted","Data":"1f1cdc30448c5034a67da2b1607926d66e9d0da3d92b4c07da1cc1a45672e3a1"}
Sep 20 00:54:06.754415 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:06.754384    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx" event={"ID":"c869858f-8d52-43b0-8241-3d5d4ca0a759","Type":"ContainerStarted","Data":"58dfc1169391b3a7f2dc40a7e4c61eb939a9ec4a0a3f202872b854ceec5906a1"}
Sep 20 00:54:06.756199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:06.756176    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c69181c-3c67-4bff-aec3-771680368b9e" containerID="52c02a76164b15ae3538cebfa0c2af22d79999308acbbedf6210b55af911e9d7" exitCode=0
Sep 20 00:54:06.756325 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:06.756221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p" event={"ID":"2c69181c-3c67-4bff-aec3-771680368b9e","Type":"ContainerDied","Data":"52c02a76164b15ae3538cebfa0c2af22d79999308acbbedf6210b55af911e9d7"}
Sep 20 00:54:07.762650 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:07.762609    2568 generic.go:356] "Generic (PLEG): container finished" podID="c869858f-8d52-43b0-8241-3d5d4ca0a759" containerID="58dfc1169391b3a7f2dc40a7e4c61eb939a9ec4a0a3f202872b854ceec5906a1" exitCode=0
Sep 20 00:54:07.763049 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:07.762704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx" event={"ID":"c869858f-8d52-43b0-8241-3d5d4ca0a759","Type":"ContainerDied","Data":"58dfc1169391b3a7f2dc40a7e4c61eb939a9ec4a0a3f202872b854ceec5906a1"}
Sep 20 00:54:07.765174 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:07.765149    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c69181c-3c67-4bff-aec3-771680368b9e" containerID="a187368bfbd226e2e1ed1f4e71b252aea38f6fcc57c392ee7438ecc96debb431" exitCode=0
Sep 20 00:54:07.765251 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:07.765230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p" event={"ID":"2c69181c-3c67-4bff-aec3-771680368b9e","Type":"ContainerDied","Data":"a187368bfbd226e2e1ed1f4e71b252aea38f6fcc57c392ee7438ecc96debb431"}
Sep 20 00:54:08.771805 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.771767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx" event={"ID":"c869858f-8d52-43b0-8241-3d5d4ca0a759","Type":"ContainerStarted","Data":"3c2488fe84533c820dac7592f3cae90e45e085bae9806b72e45d7c44f0d81a9e"}
Sep 20 00:54:08.772230 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.771960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:08.793309 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.793243    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx" podStartSLOduration=2.12159143 podStartE2EDuration="6.79322825s" totalImagesPullingTime="3.514647217s" totalInitContainerRuntime="1.156989603s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:08.791542916 +0000 UTC m=+405.041044722" watchObservedRunningTime="2026-09-20 00:54:08.79322825 +0000 UTC m=+405.042730054"
Sep 20 00:54:08.893866 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.893843    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:08.967851 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.967814    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfkvv\" (UniqueName: \"kubernetes.io/projected/2c69181c-3c67-4bff-aec3-771680368b9e-kube-api-access-gfkvv\") pod \"2c69181c-3c67-4bff-aec3-771680368b9e\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") "
Sep 20 00:54:08.968056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.967938    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-util\") pod \"2c69181c-3c67-4bff-aec3-771680368b9e\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") "
Sep 20 00:54:08.968056 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.967969    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-bundle\") pod \"2c69181c-3c67-4bff-aec3-771680368b9e\" (UID: \"2c69181c-3c67-4bff-aec3-771680368b9e\") "
Sep 20 00:54:08.968842 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.968815    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-bundle" (OuterVolumeSpecName: "bundle") pod "2c69181c-3c67-4bff-aec3-771680368b9e" (UID: "2c69181c-3c67-4bff-aec3-771680368b9e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:54:08.969953 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.969930    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c69181c-3c67-4bff-aec3-771680368b9e-kube-api-access-gfkvv" (OuterVolumeSpecName: "kube-api-access-gfkvv") pod "2c69181c-3c67-4bff-aec3-771680368b9e" (UID: "2c69181c-3c67-4bff-aec3-771680368b9e"). InnerVolumeSpecName "kube-api-access-gfkvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:54:08.972880 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:08.972851    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-util" (OuterVolumeSpecName: "util") pod "2c69181c-3c67-4bff-aec3-771680368b9e" (UID: "2c69181c-3c67-4bff-aec3-771680368b9e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:54:09.068867 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:09.068788    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:09.068867 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:09.068821    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c69181c-3c67-4bff-aec3-771680368b9e-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:09.068867 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:09.068830    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfkvv\" (UniqueName: \"kubernetes.io/projected/2c69181c-3c67-4bff-aec3-771680368b9e-kube-api-access-gfkvv\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:09.778288 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:09.778253    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p"
Sep 20 00:54:09.778288 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:09.778283    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0qhd6p" event={"ID":"2c69181c-3c67-4bff-aec3-771680368b9e","Type":"ContainerDied","Data":"13906e7f4270ba6c642004f39276e0bbd661119a237bc6c13430a4269093109d"}
Sep 20 00:54:09.778724 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:09.778330    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13906e7f4270ba6c642004f39276e0bbd661119a237bc6c13430a4269093109d"
Sep 20 00:54:19.780655 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:19.780623    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-4lltx"
Sep 20 00:54:21.647939 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.647883    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"]
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648191    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="extract"
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648203    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="extract"
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648226    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="util"
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648233    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="util"
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648245    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="pull"
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648251    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="pull"
Sep 20 00:54:21.648342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.648318    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c69181c-3c67-4bff-aec3-771680368b9e" containerName="extract"
Sep 20 00:54:21.654773 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.654751    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.658933 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.658901    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 20 00:54:21.659263 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.659250    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 20 00:54:21.679277 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.679258    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"]
Sep 20 00:54:21.764231 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.764204    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-tmp\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.764393 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.764251    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-tls-certs\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.764393 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.764298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vppwf\" (UniqueName: \"kubernetes.io/projected/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-kube-api-access-vppwf\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.865094 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.865063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-tls-certs\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.865303 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.865100    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vppwf\" (UniqueName: \"kubernetes.io/projected/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-kube-api-access-vppwf\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.865303 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.865154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-tmp\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.867278 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.867258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-tmp\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.867500 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.867480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-tls-certs\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.876613 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.876591    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vppwf\" (UniqueName: \"kubernetes.io/projected/b7272d4a-c0ce-46d4-a3bf-0181fb356cfe-kube-api-access-vppwf\") pod \"kube-auth-proxy-9c7c6d7b-xknf2\" (UID: \"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:21.964212 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:21.964175    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"
Sep 20 00:54:22.238889 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.238846    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2"]
Sep 20 00:54:22.241875 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:54:22.241846    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7272d4a_c0ce_46d4_a3bf_0181fb356cfe.slice/crio-e59857a51d219ff221a6946659ab5aba87edce630a9b86e6343ee68dec6e905e WatchSource:0}: Error finding container e59857a51d219ff221a6946659ab5aba87edce630a9b86e6343ee68dec6e905e: Status 404 returned error can't find the container with id e59857a51d219ff221a6946659ab5aba87edce630a9b86e6343ee68dec6e905e
Sep 20 00:54:22.839259 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.839212    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2" event={"ID":"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe","Type":"ContainerStarted","Data":"e59857a51d219ff221a6946659ab5aba87edce630a9b86e6343ee68dec6e905e"}
Sep 20 00:54:22.930373 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.930337    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"]
Sep 20 00:54:22.934264 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.934241    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.936855 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.936577    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 20 00:54:22.936855 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.936597    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 20 00:54:22.936855 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.936577    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 20 00:54:22.937331 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.937307    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w4chb\""
Sep 20 00:54:22.937451 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.937357    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 20 00:54:22.949281 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.949225    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"]
Sep 20 00:54:22.974582 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.974762 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl79t\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-kube-api-access-gl79t\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.974762 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e3e3bb-3814-4593-a066-886b05e717b0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.974762 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.974762 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974749    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.974970 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974801    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:22.974970 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:22.974840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076158 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl79t\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-kube-api-access-gl79t\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076347 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076182    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e3e3bb-3814-4593-a066-886b05e717b0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076347 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076347 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076347 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076347 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076325    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.076616 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.076358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.077357 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.077304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.079383 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.079320    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.079505 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.079478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.079689 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.079641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e3e3bb-3814-4593-a066-886b05e717b0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.080669 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.080649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.084952 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.084907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.085510 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.085467    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl79t\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-kube-api-access-gl79t\") pod \"istiod-openshift-gateway-7b7995d5cd-qxqgq\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.247049 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.247009    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:23.530304 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.530147    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"]
Sep 20 00:54:23.533100 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:54:23.533068    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e3e3bb_3814_4593_a066_886b05e717b0.slice/crio-0fd0ada59f9a5902fcf88683d4049dcb3ecbb9f9452139a231745cd49dfc67ee WatchSource:0}: Error finding container 0fd0ada59f9a5902fcf88683d4049dcb3ecbb9f9452139a231745cd49dfc67ee: Status 404 returned error can't find the container with id 0fd0ada59f9a5902fcf88683d4049dcb3ecbb9f9452139a231745cd49dfc67ee
Sep 20 00:54:23.846827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:23.846736    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq" event={"ID":"e7e3e3bb-3814-4593-a066-886b05e717b0","Type":"ContainerStarted","Data":"0fd0ada59f9a5902fcf88683d4049dcb3ecbb9f9452139a231745cd49dfc67ee"}
Sep 20 00:54:25.861959 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:25.861899    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2" event={"ID":"b7272d4a-c0ce-46d4-a3bf-0181fb356cfe","Type":"ContainerStarted","Data":"051ae9d730e5798609bc5eaf1fdef600e8224580e1e90d2fdfa0b2efc5925c95"}
Sep 20 00:54:25.878157 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:25.878104    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2" podStartSLOduration=2.098149232 podStartE2EDuration="4.878087041s" totalImagesPullingTime="2.779937809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:25.87650515 +0000 UTC m=+422.126006954" watchObservedRunningTime="2026-09-20 00:54:25.878087041 +0000 UTC m=+422.127588849"
Sep 20 00:54:26.989675 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:26.989637    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 00:54:26.989966 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:26.989703    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 00:54:27.873494 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:27.873453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq" event={"ID":"e7e3e3bb-3814-4593-a066-886b05e717b0","Type":"ContainerStarted","Data":"74ed75d57b8e3477672003c0be7f430c907a13a2cd979ed53ab15697f0cd039c"}
Sep 20 00:54:27.873663 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:27.873533    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:27.915572 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:27.915522    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq" podStartSLOduration=2.461733057 podStartE2EDuration="5.915506607s" totalImagesPullingTime="3.45377355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:27.912995625 +0000 UTC m=+424.162497429" watchObservedRunningTime="2026-09-20 00:54:27.915506607 +0000 UTC m=+424.165008410"
Sep 20 00:54:28.879425 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:28.879394    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:41.458071 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.457977    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"]
Sep 20 00:54:41.461495 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.461465    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:41.463683 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.463653    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-25j8m\""
Sep 20 00:54:41.463821 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.463789    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 20 00:54:41.471518 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.471491    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"]
Sep 20 00:54:41.475030 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.475011    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"]
Sep 20 00:54:41.475158 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.475097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:41.477254 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.477231    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fqx8l\""
Sep 20 00:54:41.477382 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.477364    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 20 00:54:41.486821 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.486799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"]
Sep 20 00:54:41.541759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.541727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkqn4\" (UniqueName: \"kubernetes.io/projected/743979c6-e237-488e-9826-2b5238573f67-kube-api-access-gkqn4\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:41.541902 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.541836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743979c6-e237-488e-9826-2b5238573f67-cert\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:41.642565 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.642524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:41.642565 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.642567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743979c6-e237-488e-9826-2b5238573f67-cert\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:41.642776 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.642585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvlq\" (UniqueName: \"kubernetes.io/projected/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-kube-api-access-zqvlq\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:41.642776 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:54:41.642661    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 20 00:54:41.642776 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:54:41.642719    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743979c6-e237-488e-9826-2b5238573f67-cert podName:743979c6-e237-488e-9826-2b5238573f67 nodeName:}" failed. No retries permitted until 2026-09-20 00:54:42.142702551 +0000 UTC m=+438.392204333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/743979c6-e237-488e-9826-2b5238573f67-cert") pod "kserve-controller-manager-d6f4b65b8-bbffp" (UID: "743979c6-e237-488e-9826-2b5238573f67") : secret "kserve-webhook-server-cert" not found
Sep 20 00:54:41.642776 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.642740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkqn4\" (UniqueName: \"kubernetes.io/projected/743979c6-e237-488e-9826-2b5238573f67-kube-api-access-gkqn4\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:41.659900 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.659871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkqn4\" (UniqueName: \"kubernetes.io/projected/743979c6-e237-488e-9826-2b5238573f67-kube-api-access-gkqn4\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:41.743934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.743835    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:41.743934 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.743887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvlq\" (UniqueName: \"kubernetes.io/projected/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-kube-api-access-zqvlq\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:41.744151 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:54:41.743994    2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 20 00:54:41.744151 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:54:41.744058    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-cert podName:12bd30e8-9ec1-40e4-a219-e55f4c6eb123 nodeName:}" failed. No retries permitted until 2026-09-20 00:54:42.244043456 +0000 UTC m=+438.493545243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-cert") pod "llmisvc-controller-manager-777c6bd7d5-rmkj4" (UID: "12bd30e8-9ec1-40e4-a219-e55f4c6eb123") : secret "llmisvc-webhook-server-cert" not found
Sep 20 00:54:41.761061 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:41.761039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvlq\" (UniqueName: \"kubernetes.io/projected/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-kube-api-access-zqvlq\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:42.148040 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.147951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743979c6-e237-488e-9826-2b5238573f67-cert\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:42.150333 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.150313    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743979c6-e237-488e-9826-2b5238573f67-cert\") pod \"kserve-controller-manager-d6f4b65b8-bbffp\" (UID: \"743979c6-e237-488e-9826-2b5238573f67\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:42.249321 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.249288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:42.251525 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.251505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bd30e8-9ec1-40e4-a219-e55f4c6eb123-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rmkj4\" (UID: \"12bd30e8-9ec1-40e4-a219-e55f4c6eb123\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:42.372420 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.372384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:42.387582 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.387562    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:42.656106 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.656071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"]
Sep 20 00:54:42.660169 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:54:42.660135    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743979c6_e237_488e_9826_2b5238573f67.slice/crio-d6b01cbfd89e46e39c9d536b8d8c510cf363588029d7db26bc1d21e8d2d8942d WatchSource:0}: Error finding container d6b01cbfd89e46e39c9d536b8d8c510cf363588029d7db26bc1d21e8d2d8942d: Status 404 returned error can't find the container with id d6b01cbfd89e46e39c9d536b8d8c510cf363588029d7db26bc1d21e8d2d8942d
Sep 20 00:54:42.683127 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.683106    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"]
Sep 20 00:54:42.684803 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:54:42.684776    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12bd30e8_9ec1_40e4_a219_e55f4c6eb123.slice/crio-76bc4b46d663b0616a5a49cdfacb1d5672fc568e90851f9e04b342160f02af0a WatchSource:0}: Error finding container 76bc4b46d663b0616a5a49cdfacb1d5672fc568e90851f9e04b342160f02af0a: Status 404 returned error can't find the container with id 76bc4b46d663b0616a5a49cdfacb1d5672fc568e90851f9e04b342160f02af0a
Sep 20 00:54:42.941813 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.941725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4" event={"ID":"12bd30e8-9ec1-40e4-a219-e55f4c6eb123","Type":"ContainerStarted","Data":"76bc4b46d663b0616a5a49cdfacb1d5672fc568e90851f9e04b342160f02af0a"}
Sep 20 00:54:42.942978 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:42.942954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp" event={"ID":"743979c6-e237-488e-9826-2b5238573f67","Type":"ContainerStarted","Data":"d6b01cbfd89e46e39c9d536b8d8c510cf363588029d7db26bc1d21e8d2d8942d"}
Sep 20 00:54:44.528775 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:44.528735    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"]
Sep 20 00:54:44.529250 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:44.528995    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq" podUID="e7e3e3bb-3814-4593-a066-886b05e717b0" containerName="discovery" containerID="cri-o://74ed75d57b8e3477672003c0be7f430c907a13a2cd979ed53ab15697f0cd039c" gracePeriod=30
Sep 20 00:54:44.956753 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:44.956715    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7e3e3bb-3814-4593-a066-886b05e717b0" containerID="74ed75d57b8e3477672003c0be7f430c907a13a2cd979ed53ab15697f0cd039c" exitCode=0
Sep 20 00:54:44.956910 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:44.956775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq" event={"ID":"e7e3e3bb-3814-4593-a066-886b05e717b0","Type":"ContainerDied","Data":"74ed75d57b8e3477672003c0be7f430c907a13a2cd979ed53ab15697f0cd039c"}
Sep 20 00:54:45.464075 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.464051    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:45.579332 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579297    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-ca-configmap\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579332 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579334    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-cacerts\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579359    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-kubeconfig\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579392    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-dns-cert\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579449    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl79t\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-kube-api-access-gl79t\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579478    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e3e3bb-3814-4593-a066-886b05e717b0-local-certs\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-token\") pod \"e7e3e3bb-3814-4593-a066-886b05e717b0\" (UID: \"e7e3e3bb-3814-4593-a066-886b05e717b0\") "
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579691    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:54:45.579827 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.579782    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-ca-configmap\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.581980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.581937    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-kube-api-access-gl79t" (OuterVolumeSpecName: "kube-api-access-gl79t") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "kube-api-access-gl79t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:54:45.581980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.581960    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:54:45.582149 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.582005    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-cacerts" (OuterVolumeSpecName: "cacerts") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:54:45.582149 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.582087    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e3e3bb-3814-4593-a066-886b05e717b0-local-certs" (OuterVolumeSpecName: "local-certs") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:54:45.582149 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.582106    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:54:45.582149 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.582107    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7e3e3bb-3814-4593-a066-886b05e717b0" (UID: "e7e3e3bb-3814-4593-a066-886b05e717b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:54:45.680463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.680424    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-kubeconfig\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.680463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.680456    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-csr-dns-cert\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.680463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.680467    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl79t\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-kube-api-access-gl79t\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.680681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.680476    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e3e3bb-3814-4593-a066-886b05e717b0-local-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.680681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.680486    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e3e3bb-3814-4593-a066-886b05e717b0-istio-token\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.680681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.680494    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7e3e3bb-3814-4593-a066-886b05e717b0-cacerts\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:54:45.963609 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.963567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp" event={"ID":"743979c6-e237-488e-9826-2b5238573f67","Type":"ContainerStarted","Data":"cf7a128e8b72b4b54f3bdff62f49889f15a108ccda947d491481988ebc53c3d2"}
Sep 20 00:54:45.963781 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.963634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:54:45.964971 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.964946    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"
Sep 20 00:54:45.965073 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.964973    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq" event={"ID":"e7e3e3bb-3814-4593-a066-886b05e717b0","Type":"ContainerDied","Data":"0fd0ada59f9a5902fcf88683d4049dcb3ecbb9f9452139a231745cd49dfc67ee"}
Sep 20 00:54:45.965073 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.965025    2568 scope.go:117] "RemoveContainer" containerID="74ed75d57b8e3477672003c0be7f430c907a13a2cd979ed53ab15697f0cd039c"
Sep 20 00:54:45.966671 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.966648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4" event={"ID":"12bd30e8-9ec1-40e4-a219-e55f4c6eb123","Type":"ContainerStarted","Data":"d8ae91be6b1e4d2e88f06db831976445b4c891eec2365984729c51967c733eeb"}
Sep 20 00:54:45.966760 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.966710    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:54:45.978285 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.978248    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp" podStartSLOduration=2.161002109 podStartE2EDuration="4.978233858s" totalImagesPullingTime="2.817231749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:45.977335096 +0000 UTC m=+442.226836900" watchObservedRunningTime="2026-09-20 00:54:45.978233858 +0000 UTC m=+442.227735661"
Sep 20 00:54:45.991467 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.991445    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"]
Sep 20 00:54:45.995332 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:45.995310    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq"]
Sep 20 00:54:46.006811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:46.006718    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4" podStartSLOduration=2.207727851 podStartE2EDuration="5.006701448s" totalImagesPullingTime="2.798973597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:46.005665374 +0000 UTC m=+442.255167178" watchObservedRunningTime="2026-09-20 00:54:46.006701448 +0000 UTC m=+442.256203253"
Sep 20 00:54:47.986249 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:54:47.986212    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e3e3bb-3814-4593-a066-886b05e717b0" path="/var/lib/kubelet/pods/e7e3e3bb-3814-4593-a066-886b05e717b0/volumes"
Sep 20 00:55:16.974764 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:16.974732    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rmkj4"
Sep 20 00:55:16.978114 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:16.978083    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bbffp"
Sep 20 00:55:36.997200 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:36.997169    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"]
Sep 20 00:55:36.997632 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:36.997462    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e3e3bb-3814-4593-a066-886b05e717b0" containerName="discovery"
Sep 20 00:55:36.997632 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:36.997472    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e3e3bb-3814-4593-a066-886b05e717b0" containerName="discovery"
Sep 20 00:55:36.997632 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:36.997536    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e3e3bb-3814-4593-a066-886b05e717b0" containerName="discovery"
Sep 20 00:55:37.002268 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.002250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.004489 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.004469    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 20 00:55:37.005006 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.004990    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 20 00:55:37.005066 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.005010    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6pstm\""
Sep 20 00:55:37.010111 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.010083    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"]
Sep 20 00:55:37.090866 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.090832    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"]
Sep 20 00:55:37.093306 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.093285    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.097288 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.097256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.097416 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.097339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2z76\" (UniqueName: \"kubernetes.io/projected/58d05ec7-0dc2-4a50-a952-762d2d6e072e-kube-api-access-l2z76\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.097416 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.097368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.108694 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.103671    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"]
Sep 20 00:55:37.193605 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.193563    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"]
Sep 20 00:55:37.196075 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.196052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.198416 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxcmt\" (UniqueName: \"kubernetes.io/projected/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-kube-api-access-fxcmt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.198533 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198430    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.198533 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2z76\" (UniqueName: \"kubernetes.io/projected/58d05ec7-0dc2-4a50-a952-762d2d6e072e-kube-api-access-l2z76\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.198533 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198502    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.198681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.198681 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.198893 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.198962 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.198890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.205404 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.205378    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"]
Sep 20 00:55:37.207796 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.207769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2z76\" (UniqueName: \"kubernetes.io/projected/58d05ec7-0dc2-4a50-a952-762d2d6e072e-kube-api-access-l2z76\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.294417 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.294355    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"]
Sep 20 00:55:37.296831 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.296815    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.298960 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.298931    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.299061 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcmt\" (UniqueName: \"kubernetes.io/projected/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-kube-api-access-fxcmt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.299061 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.299170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86tcr\" (UniqueName: \"kubernetes.io/projected/0ec2a3d8-982b-42cc-81f4-55165a1d1539-kube-api-access-86tcr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.299170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.299170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.299409 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.299533 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.299516    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.305441 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.305410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"]
Sep 20 00:55:37.307621 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.307594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxcmt\" (UniqueName: \"kubernetes.io/projected/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-kube-api-access-fxcmt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.311346 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.311326    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:37.399833 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.399804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86tcr\" (UniqueName: \"kubernetes.io/projected/0ec2a3d8-982b-42cc-81f4-55165a1d1539-kube-api-access-86tcr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.400007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.399849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.400007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.399873    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.400007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.399909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6d8n\" (UniqueName: \"kubernetes.io/projected/41af0104-80a5-4bd8-b829-01e3c2175744-kube-api-access-j6d8n\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.400007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.399964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.400007 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.399985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.400368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.400350    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.400427 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.400401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.403752 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.403733    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:37.407774 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.407756    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86tcr\" (UniqueName: \"kubernetes.io/projected/0ec2a3d8-982b-42cc-81f4-55165a1d1539-kube-api-access-86tcr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.501398 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.501368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.501563 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.501419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6d8n\" (UniqueName: \"kubernetes.io/projected/41af0104-80a5-4bd8-b829-01e3c2175744-kube-api-access-j6d8n\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.501563 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.501452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.501747 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.501728    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.501812 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.501798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.506627 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.506606    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:37.508908 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.508890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6d8n\" (UniqueName: \"kubernetes.io/projected/41af0104-80a5-4bd8-b829-01e3c2175744-kube-api-access-j6d8n\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.581949 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.581880    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"]
Sep 20 00:55:37.583173 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:37.583143    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d05ec7_0dc2_4a50_a952_762d2d6e072e.slice/crio-1da487651b8ce7a95971820ffb2e1caa55f6f852e16da9ae0d75a4217e72cf56 WatchSource:0}: Error finding container 1da487651b8ce7a95971820ffb2e1caa55f6f852e16da9ae0d75a4217e72cf56: Status 404 returned error can't find the container with id 1da487651b8ce7a95971820ffb2e1caa55f6f852e16da9ae0d75a4217e72cf56
Sep 20 00:55:37.607276 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.607248    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:37.676068 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.676042    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"]
Sep 20 00:55:37.676169 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:37.676114    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1291952e_18c3_4ebf_b7b3_1e60dbe2d613.slice/crio-0a824fa776716d3c22834d591848e3788d001ac2bb97e41d0b9a5722c2d1a1cd WatchSource:0}: Error finding container 0a824fa776716d3c22834d591848e3788d001ac2bb97e41d0b9a5722c2d1a1cd: Status 404 returned error can't find the container with id 0a824fa776716d3c22834d591848e3788d001ac2bb97e41d0b9a5722c2d1a1cd
Sep 20 00:55:37.777818 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.777790    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"]
Sep 20 00:55:37.779319 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:37.779300    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec2a3d8_982b_42cc_81f4_55165a1d1539.slice/crio-d3822b4167c5524cc5720e91c6b631a1775c4ed22d2cf83b4251bdc6136be6c2 WatchSource:0}: Error finding container d3822b4167c5524cc5720e91c6b631a1775c4ed22d2cf83b4251bdc6136be6c2: Status 404 returned error can't find the container with id d3822b4167c5524cc5720e91c6b631a1775c4ed22d2cf83b4251bdc6136be6c2
Sep 20 00:55:37.877259 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:37.877229    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"]
Sep 20 00:55:37.879933 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:37.879896    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41af0104_80a5_4bd8_b829_01e3c2175744.slice/crio-959897b8a9fda3deb338abef164cce890b658fe699ef44aeb12bc5bc0e5429a4 WatchSource:0}: Error finding container 959897b8a9fda3deb338abef164cce890b658fe699ef44aeb12bc5bc0e5429a4: Status 404 returned error can't find the container with id 959897b8a9fda3deb338abef164cce890b658fe699ef44aeb12bc5bc0e5429a4
Sep 20 00:55:38.209694 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.209658    2568 generic.go:356] "Generic (PLEG): container finished" podID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerID="5d184d37bb78d12f1baa9ccdede084c8d69be893cfb74448c5235134a1c526c1" exitCode=0
Sep 20 00:55:38.210158 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.209725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb" event={"ID":"1291952e-18c3-4ebf-b7b3-1e60dbe2d613","Type":"ContainerDied","Data":"5d184d37bb78d12f1baa9ccdede084c8d69be893cfb74448c5235134a1c526c1"}
Sep 20 00:55:38.210158 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.209765    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb" event={"ID":"1291952e-18c3-4ebf-b7b3-1e60dbe2d613","Type":"ContainerStarted","Data":"0a824fa776716d3c22834d591848e3788d001ac2bb97e41d0b9a5722c2d1a1cd"}
Sep 20 00:55:38.214412 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.214384    2568 generic.go:356] "Generic (PLEG): container finished" podID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerID="f2c0b5811dfa9cd6ddd2ea907c232d95f236cbd07117ae6adc1ff87241d901c5" exitCode=0
Sep 20 00:55:38.214528 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.214467    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6" event={"ID":"58d05ec7-0dc2-4a50-a952-762d2d6e072e","Type":"ContainerDied","Data":"f2c0b5811dfa9cd6ddd2ea907c232d95f236cbd07117ae6adc1ff87241d901c5"}
Sep 20 00:55:38.214585 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.214531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6" event={"ID":"58d05ec7-0dc2-4a50-a952-762d2d6e072e","Type":"ContainerStarted","Data":"1da487651b8ce7a95971820ffb2e1caa55f6f852e16da9ae0d75a4217e72cf56"}
Sep 20 00:55:38.216470 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.216447    2568 generic.go:356] "Generic (PLEG): container finished" podID="41af0104-80a5-4bd8-b829-01e3c2175744" containerID="df66f6c9f833b0b23931f7ef232c07446cbc543f6a613152aaefb5cee2d209af" exitCode=0
Sep 20 00:55:38.216577 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.216533    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq" event={"ID":"41af0104-80a5-4bd8-b829-01e3c2175744","Type":"ContainerDied","Data":"df66f6c9f833b0b23931f7ef232c07446cbc543f6a613152aaefb5cee2d209af"}
Sep 20 00:55:38.216638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.216575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq" event={"ID":"41af0104-80a5-4bd8-b829-01e3c2175744","Type":"ContainerStarted","Data":"959897b8a9fda3deb338abef164cce890b658fe699ef44aeb12bc5bc0e5429a4"}
Sep 20 00:55:38.218656 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.218634    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerID="270f6dfc0faffa15567a9c46ed450297d3c3e38afbf6c57828673020c6fb4a6d" exitCode=0
Sep 20 00:55:38.218747 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.218690    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l" event={"ID":"0ec2a3d8-982b-42cc-81f4-55165a1d1539","Type":"ContainerDied","Data":"270f6dfc0faffa15567a9c46ed450297d3c3e38afbf6c57828673020c6fb4a6d"}
Sep 20 00:55:38.218747 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:38.218722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l" event={"ID":"0ec2a3d8-982b-42cc-81f4-55165a1d1539","Type":"ContainerStarted","Data":"d3822b4167c5524cc5720e91c6b631a1775c4ed22d2cf83b4251bdc6136be6c2"}
Sep 20 00:55:39.227561 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:39.227533    2568 generic.go:356] "Generic (PLEG): container finished" podID="41af0104-80a5-4bd8-b829-01e3c2175744" containerID="2d0cf600428e6ab73c14c54dc107c6eac2753808c9daac6bddbcf236f5bec97f" exitCode=0
Sep 20 00:55:39.227947 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:39.227614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq" event={"ID":"41af0104-80a5-4bd8-b829-01e3c2175744","Type":"ContainerDied","Data":"2d0cf600428e6ab73c14c54dc107c6eac2753808c9daac6bddbcf236f5bec97f"}
Sep 20 00:55:40.234492 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.234457    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerID="350521803e7c582b479f9a0e73ee3f882fcd8d8cd9ed74aa16a64397d526d1da" exitCode=0
Sep 20 00:55:40.234975 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.234555    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l" event={"ID":"0ec2a3d8-982b-42cc-81f4-55165a1d1539","Type":"ContainerDied","Data":"350521803e7c582b479f9a0e73ee3f882fcd8d8cd9ed74aa16a64397d526d1da"}
Sep 20 00:55:40.236567 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.236540    2568 generic.go:356] "Generic (PLEG): container finished" podID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerID="60630206967d5d2b18e8b6147ae66ba9d0393d90f9eb06c06ac88b44b675584a" exitCode=0
Sep 20 00:55:40.236665 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.236625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb" event={"ID":"1291952e-18c3-4ebf-b7b3-1e60dbe2d613","Type":"ContainerDied","Data":"60630206967d5d2b18e8b6147ae66ba9d0393d90f9eb06c06ac88b44b675584a"}
Sep 20 00:55:40.238620 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.238600    2568 generic.go:356] "Generic (PLEG): container finished" podID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerID="b9c924111faa50eaa67ca0b16c80f162b08e8e837d9ec7c0c15d41c48da999ea" exitCode=0
Sep 20 00:55:40.238730 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.238669    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6" event={"ID":"58d05ec7-0dc2-4a50-a952-762d2d6e072e","Type":"ContainerDied","Data":"b9c924111faa50eaa67ca0b16c80f162b08e8e837d9ec7c0c15d41c48da999ea"}
Sep 20 00:55:40.240932 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.240899    2568 generic.go:356] "Generic (PLEG): container finished" podID="41af0104-80a5-4bd8-b829-01e3c2175744" containerID="010919ef4569499b16c35c4641dfb1dfb0196b70d3ebf5aa4d4d7ab5a7f09bd6" exitCode=0
Sep 20 00:55:40.241016 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:40.240950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq" event={"ID":"41af0104-80a5-4bd8-b829-01e3c2175744","Type":"ContainerDied","Data":"010919ef4569499b16c35c4641dfb1dfb0196b70d3ebf5aa4d4d7ab5a7f09bd6"}
Sep 20 00:55:41.248170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.248140    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerID="18b51a461c2ef1a20f606c1d8da88c396c684ff470f77df4d2a54ead1b53f1e8" exitCode=0
Sep 20 00:55:41.248563 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.248220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l" event={"ID":"0ec2a3d8-982b-42cc-81f4-55165a1d1539","Type":"ContainerDied","Data":"18b51a461c2ef1a20f606c1d8da88c396c684ff470f77df4d2a54ead1b53f1e8"}
Sep 20 00:55:41.250323 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.250299    2568 generic.go:356] "Generic (PLEG): container finished" podID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerID="b53813a27434bd7344a92d2f0941d34b59ff137ab5c1c0c13d98631ccd28a7fb" exitCode=0
Sep 20 00:55:41.250419 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.250378    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb" event={"ID":"1291952e-18c3-4ebf-b7b3-1e60dbe2d613","Type":"ContainerDied","Data":"b53813a27434bd7344a92d2f0941d34b59ff137ab5c1c0c13d98631ccd28a7fb"}
Sep 20 00:55:41.252486 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.252466    2568 generic.go:356] "Generic (PLEG): container finished" podID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerID="c1fbb4765bf798ea19fd3bfcff8e5866be765c84169b1e41bf166f7540c7855f" exitCode=0
Sep 20 00:55:41.252601 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.252547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6" event={"ID":"58d05ec7-0dc2-4a50-a952-762d2d6e072e","Type":"ContainerDied","Data":"c1fbb4765bf798ea19fd3bfcff8e5866be765c84169b1e41bf166f7540c7855f"}
Sep 20 00:55:41.381312 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.381290    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:41.534750 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.534657    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6d8n\" (UniqueName: \"kubernetes.io/projected/41af0104-80a5-4bd8-b829-01e3c2175744-kube-api-access-j6d8n\") pod \"41af0104-80a5-4bd8-b829-01e3c2175744\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") "
Sep 20 00:55:41.534750 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.534716    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-bundle\") pod \"41af0104-80a5-4bd8-b829-01e3c2175744\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") "
Sep 20 00:55:41.534750 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.534746    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-util\") pod \"41af0104-80a5-4bd8-b829-01e3c2175744\" (UID: \"41af0104-80a5-4bd8-b829-01e3c2175744\") "
Sep 20 00:55:41.535313 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.535282    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-bundle" (OuterVolumeSpecName: "bundle") pod "41af0104-80a5-4bd8-b829-01e3c2175744" (UID: "41af0104-80a5-4bd8-b829-01e3c2175744"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:41.536791 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.536768    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41af0104-80a5-4bd8-b829-01e3c2175744-kube-api-access-j6d8n" (OuterVolumeSpecName: "kube-api-access-j6d8n") pod "41af0104-80a5-4bd8-b829-01e3c2175744" (UID: "41af0104-80a5-4bd8-b829-01e3c2175744"). InnerVolumeSpecName "kube-api-access-j6d8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:55:41.539766 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.539730    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-util" (OuterVolumeSpecName: "util") pod "41af0104-80a5-4bd8-b829-01e3c2175744" (UID: "41af0104-80a5-4bd8-b829-01e3c2175744"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:41.635751 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.635718    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6d8n\" (UniqueName: \"kubernetes.io/projected/41af0104-80a5-4bd8-b829-01e3c2175744-kube-api-access-j6d8n\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:41.635751 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.635744    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:41.635751 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:41.635754    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41af0104-80a5-4bd8-b829-01e3c2175744-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.264510 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.264430    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq"
Sep 20 00:55:42.264510 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.264457    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck7dbq" event={"ID":"41af0104-80a5-4bd8-b829-01e3c2175744","Type":"ContainerDied","Data":"959897b8a9fda3deb338abef164cce890b658fe699ef44aeb12bc5bc0e5429a4"}
Sep 20 00:55:42.264911 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.264531    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="959897b8a9fda3deb338abef164cce890b658fe699ef44aeb12bc5bc0e5429a4"
Sep 20 00:55:42.415001 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.414978    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:42.457812 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.457787    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:42.460958 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.460935    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:42.542180 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.542104    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-bundle\") pod \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") "
Sep 20 00:55:42.542180 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.542144    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxcmt\" (UniqueName: \"kubernetes.io/projected/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-kube-api-access-fxcmt\") pod \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") "
Sep 20 00:55:42.542347 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.542189    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-util\") pod \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\" (UID: \"1291952e-18c3-4ebf-b7b3-1e60dbe2d613\") "
Sep 20 00:55:42.542957 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.542888    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-bundle" (OuterVolumeSpecName: "bundle") pod "1291952e-18c3-4ebf-b7b3-1e60dbe2d613" (UID: "1291952e-18c3-4ebf-b7b3-1e60dbe2d613"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:42.544364 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.544341    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-kube-api-access-fxcmt" (OuterVolumeSpecName: "kube-api-access-fxcmt") pod "1291952e-18c3-4ebf-b7b3-1e60dbe2d613" (UID: "1291952e-18c3-4ebf-b7b3-1e60dbe2d613"). InnerVolumeSpecName "kube-api-access-fxcmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:55:42.548087 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.548068    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-util" (OuterVolumeSpecName: "util") pod "1291952e-18c3-4ebf-b7b3-1e60dbe2d613" (UID: "1291952e-18c3-4ebf-b7b3-1e60dbe2d613"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:42.642748 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.642715    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-bundle\") pod \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") "
Sep 20 00:55:42.642890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.642770    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-util\") pod \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") "
Sep 20 00:55:42.642890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.642791    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-util\") pod \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") "
Sep 20 00:55:42.642890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.642817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86tcr\" (UniqueName: \"kubernetes.io/projected/0ec2a3d8-982b-42cc-81f4-55165a1d1539-kube-api-access-86tcr\") pod \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\" (UID: \"0ec2a3d8-982b-42cc-81f4-55165a1d1539\") "
Sep 20 00:55:42.642890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.642842    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2z76\" (UniqueName: \"kubernetes.io/projected/58d05ec7-0dc2-4a50-a952-762d2d6e072e-kube-api-access-l2z76\") pod \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") "
Sep 20 00:55:42.642890 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.642873    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-bundle\") pod \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\" (UID: \"58d05ec7-0dc2-4a50-a952-762d2d6e072e\") "
Sep 20 00:55:42.643199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.643087    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.643199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.643103    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxcmt\" (UniqueName: \"kubernetes.io/projected/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-kube-api-access-fxcmt\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.643199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.643114    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1291952e-18c3-4ebf-b7b3-1e60dbe2d613-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.643423 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.643301    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-bundle" (OuterVolumeSpecName: "bundle") pod "0ec2a3d8-982b-42cc-81f4-55165a1d1539" (UID: "0ec2a3d8-982b-42cc-81f4-55165a1d1539"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:42.643683 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.643656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-bundle" (OuterVolumeSpecName: "bundle") pod "58d05ec7-0dc2-4a50-a952-762d2d6e072e" (UID: "58d05ec7-0dc2-4a50-a952-762d2d6e072e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:42.645425 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.645404    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d05ec7-0dc2-4a50-a952-762d2d6e072e-kube-api-access-l2z76" (OuterVolumeSpecName: "kube-api-access-l2z76") pod "58d05ec7-0dc2-4a50-a952-762d2d6e072e" (UID: "58d05ec7-0dc2-4a50-a952-762d2d6e072e"). InnerVolumeSpecName "kube-api-access-l2z76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:55:42.645487 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.645433    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec2a3d8-982b-42cc-81f4-55165a1d1539-kube-api-access-86tcr" (OuterVolumeSpecName: "kube-api-access-86tcr") pod "0ec2a3d8-982b-42cc-81f4-55165a1d1539" (UID: "0ec2a3d8-982b-42cc-81f4-55165a1d1539"). InnerVolumeSpecName "kube-api-access-86tcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:55:42.648678 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.648657    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-util" (OuterVolumeSpecName: "util") pod "0ec2a3d8-982b-42cc-81f4-55165a1d1539" (UID: "0ec2a3d8-982b-42cc-81f4-55165a1d1539"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:42.649565 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.649545    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-util" (OuterVolumeSpecName: "util") pod "58d05ec7-0dc2-4a50-a952-762d2d6e072e" (UID: "58d05ec7-0dc2-4a50-a952-762d2d6e072e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:55:42.744062 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.744025    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.744062 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.744057    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-bundle\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.744062 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.744066    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d05ec7-0dc2-4a50-a952-762d2d6e072e-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.744333 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.744073    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ec2a3d8-982b-42cc-81f4-55165a1d1539-util\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.744333 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.744082    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86tcr\" (UniqueName: \"kubernetes.io/projected/0ec2a3d8-982b-42cc-81f4-55165a1d1539-kube-api-access-86tcr\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:42.744333 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:42.744093    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2z76\" (UniqueName: \"kubernetes.io/projected/58d05ec7-0dc2-4a50-a952-762d2d6e072e-kube-api-access-l2z76\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:55:43.271276 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.271247    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l"
Sep 20 00:55:43.271674 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.271274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zck2l" event={"ID":"0ec2a3d8-982b-42cc-81f4-55165a1d1539","Type":"ContainerDied","Data":"d3822b4167c5524cc5720e91c6b631a1775c4ed22d2cf83b4251bdc6136be6c2"}
Sep 20 00:55:43.271674 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.271319    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3822b4167c5524cc5720e91c6b631a1775c4ed22d2cf83b4251bdc6136be6c2"
Sep 20 00:55:43.273367 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.273343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb" event={"ID":"1291952e-18c3-4ebf-b7b3-1e60dbe2d613","Type":"ContainerDied","Data":"0a824fa776716d3c22834d591848e3788d001ac2bb97e41d0b9a5722c2d1a1cd"}
Sep 20 00:55:43.273487 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.273368    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9k5jb"
Sep 20 00:55:43.273487 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.273378    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a824fa776716d3c22834d591848e3788d001ac2bb97e41d0b9a5722c2d1a1cd"
Sep 20 00:55:43.275309 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.275286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6" event={"ID":"58d05ec7-0dc2-4a50-a952-762d2d6e072e","Type":"ContainerDied","Data":"1da487651b8ce7a95971820ffb2e1caa55f6f852e16da9ae0d75a4217e72cf56"}
Sep 20 00:55:43.275386 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.275322    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1da487651b8ce7a95971820ffb2e1caa55f6f852e16da9ae0d75a4217e72cf56"
Sep 20 00:55:43.275386 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:43.275332    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r9xh6"
Sep 20 00:55:49.546650 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546613    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"]
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546930    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546942    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546950    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546955    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546962    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546967    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546975    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546980    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546988    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546993    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.546999    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547005    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547012    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547017    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547021    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547026    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="pull"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547034    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547040    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547046    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547051    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="util"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547059    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547064    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547071    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="extract"
Sep 20 00:55:49.547074 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547076    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="extract"
Sep 20 00:55:49.547723 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547123    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1291952e-18c3-4ebf-b7b3-1e60dbe2d613" containerName="extract"
Sep 20 00:55:49.547723 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547132    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="41af0104-80a5-4bd8-b829-01e3c2175744" containerName="extract"
Sep 20 00:55:49.547723 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547138    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec2a3d8-982b-42cc-81f4-55165a1d1539" containerName="extract"
Sep 20 00:55:49.547723 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.547144    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d05ec7-0dc2-4a50-a952-762d2d6e072e" containerName="extract"
Sep 20 00:55:49.551368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.551351    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:55:49.554129 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.554104    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 20 00:55:49.554261 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.554204    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tk6k9\""
Sep 20 00:55:49.554261 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.554244    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 20 00:55:49.554402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.554319    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 20 00:55:49.561706 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.561685    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"]
Sep 20 00:55:49.587979 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.587954    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkkwt\" (UniqueName: \"kubernetes.io/projected/5445eae0-5430-469f-9efd-9868daf6bc41-kube-api-access-kkkwt\") pod \"dns-operator-controller-manager-7b84cd7c9c-klgcg\" (UID: \"5445eae0-5430-469f-9efd-9868daf6bc41\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:55:49.688526 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.688498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkkwt\" (UniqueName: \"kubernetes.io/projected/5445eae0-5430-469f-9efd-9868daf6bc41-kube-api-access-kkkwt\") pod \"dns-operator-controller-manager-7b84cd7c9c-klgcg\" (UID: \"5445eae0-5430-469f-9efd-9868daf6bc41\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:55:49.704201 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.704180    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkkwt\" (UniqueName: \"kubernetes.io/projected/5445eae0-5430-469f-9efd-9868daf6bc41-kube-api-access-kkkwt\") pod \"dns-operator-controller-manager-7b84cd7c9c-klgcg\" (UID: \"5445eae0-5430-469f-9efd-9868daf6bc41\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:55:49.861962 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:49.861872    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:55:50.137340 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:50.137313    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"]
Sep 20 00:55:50.139363 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:50.139337    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5445eae0_5430_469f_9efd_9868daf6bc41.slice/crio-b434f6fa461013fbcfb79501532c3d05cfbb4f8591c34f1cc18a5efbd1a3ae91 WatchSource:0}: Error finding container b434f6fa461013fbcfb79501532c3d05cfbb4f8591c34f1cc18a5efbd1a3ae91: Status 404 returned error can't find the container with id b434f6fa461013fbcfb79501532c3d05cfbb4f8591c34f1cc18a5efbd1a3ae91
Sep 20 00:55:50.309495 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:50.309462    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg" event={"ID":"5445eae0-5430-469f-9efd-9868daf6bc41","Type":"ContainerStarted","Data":"b434f6fa461013fbcfb79501532c3d05cfbb4f8591c34f1cc18a5efbd1a3ae91"}
Sep 20 00:55:51.995300 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:51.995270    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kk8dm"]
Sep 20 00:55:52.003817 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.003787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:55:52.005609 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.005576    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dwl\" (UniqueName: \"kubernetes.io/projected/5ad82315-76c7-40fe-8a82-bca9a5b1f185-kube-api-access-s4dwl\") pod \"authorino-operator-76b478bd78-kk8dm\" (UID: \"5ad82315-76c7-40fe-8a82-bca9a5b1f185\") " pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:55:52.006154 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.006129    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8r4rf\""
Sep 20 00:55:52.009980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.009958    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kk8dm"]
Sep 20 00:55:52.106912 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.106875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dwl\" (UniqueName: \"kubernetes.io/projected/5ad82315-76c7-40fe-8a82-bca9a5b1f185-kube-api-access-s4dwl\") pod \"authorino-operator-76b478bd78-kk8dm\" (UID: \"5ad82315-76c7-40fe-8a82-bca9a5b1f185\") " pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:55:52.121025 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.120952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dwl\" (UniqueName: \"kubernetes.io/projected/5ad82315-76c7-40fe-8a82-bca9a5b1f185-kube-api-access-s4dwl\") pod \"authorino-operator-76b478bd78-kk8dm\" (UID: \"5ad82315-76c7-40fe-8a82-bca9a5b1f185\") " pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:55:52.317241 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.317159    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:55:52.952979 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:52.952948    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kk8dm"]
Sep 20 00:55:52.954536 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:52.954509    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad82315_76c7_40fe_8a82_bca9a5b1f185.slice/crio-d9a4c218c1ebba80ceee105cc643a7eec22b5517f8cdbba4f4a52c786e5a67fd WatchSource:0}: Error finding container d9a4c218c1ebba80ceee105cc643a7eec22b5517f8cdbba4f4a52c786e5a67fd: Status 404 returned error can't find the container with id d9a4c218c1ebba80ceee105cc643a7eec22b5517f8cdbba4f4a52c786e5a67fd
Sep 20 00:55:53.328385 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:53.328275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg" event={"ID":"5445eae0-5430-469f-9efd-9868daf6bc41","Type":"ContainerStarted","Data":"3567b7086a355e9a31460f7e2af9e22de9e41d7805ac817a5e57c4ea18c41b5c"}
Sep 20 00:55:53.328803 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:53.328424    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:55:53.329718 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:53.329689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm" event={"ID":"5ad82315-76c7-40fe-8a82-bca9a5b1f185","Type":"ContainerStarted","Data":"d9a4c218c1ebba80ceee105cc643a7eec22b5517f8cdbba4f4a52c786e5a67fd"}
Sep 20 00:55:53.349571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:53.349518    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg" podStartSLOduration=1.736038244 podStartE2EDuration="4.349502666s" totalImagesPullingTime="2.613464422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:55:53.349132603 +0000 UTC m=+509.598634401" watchObservedRunningTime="2026-09-20 00:55:53.349502666 +0000 UTC m=+509.599004471"
Sep 20 00:55:55.341526 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:55.341494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm" event={"ID":"5ad82315-76c7-40fe-8a82-bca9a5b1f185","Type":"ContainerStarted","Data":"c5bfac894927f3b6ae18d6d0d6fab8a9978c9d3bd35598a36c3de609fec504bd"}
Sep 20 00:55:55.341951 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:55.341619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:55:55.360224 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:55.360176    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm" podStartSLOduration=2.772436346 podStartE2EDuration="4.360161096s" totalImagesPullingTime="1.58772475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:55:55.358984093 +0000 UTC m=+511.608485899" watchObservedRunningTime="2026-09-20 00:55:55.360161096 +0000 UTC m=+511.609662920"
Sep 20 00:55:56.396978 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.396943    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"]
Sep 20 00:55:56.400426 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.400409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.403991 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.403975    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nfvhq\""
Sep 20 00:55:56.412246 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.412223    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"]
Sep 20 00:55:56.536218 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.536167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbsls\" (UniqueName: \"kubernetes.io/projected/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-kube-api-access-nbsls\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.536374 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.536233    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.637244 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.637201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbsls\" (UniqueName: \"kubernetes.io/projected/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-kube-api-access-nbsls\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.637409 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.637262    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.637672 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.637650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.649734 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.649675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbsls\" (UniqueName: \"kubernetes.io/projected/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-kube-api-access-nbsls\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:56.710559 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:56.710531    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:55:57.002010 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:57.001980    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafcd0ea1_29d9_4ffa_befd_877221ee1ad2.slice/crio-677c9b50f7a74d5cd62d3ef045796fe89d74350619504bc917b6a6047c94067c WatchSource:0}: Error finding container 677c9b50f7a74d5cd62d3ef045796fe89d74350619504bc917b6a6047c94067c: Status 404 returned error can't find the container with id 677c9b50f7a74d5cd62d3ef045796fe89d74350619504bc917b6a6047c94067c
Sep 20 00:55:57.002759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:57.002737    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"]
Sep 20 00:55:57.352739 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:57.352659    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k" event={"ID":"afcd0ea1-29d9-4ffa-befd-877221ee1ad2","Type":"ContainerStarted","Data":"677c9b50f7a74d5cd62d3ef045796fe89d74350619504bc917b6a6047c94067c"}
Sep 20 00:55:58.805903 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.805862    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"]
Sep 20 00:55:58.809638 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.809611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:55:58.811790 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.811759    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fkrdb\""
Sep 20 00:55:58.817818 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.817791    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"]
Sep 20 00:55:58.855658 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.855626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4fx\" (UniqueName: \"kubernetes.io/projected/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6-kube-api-access-fw4fx\") pod \"limitador-operator-controller-manager-74495c69f8-pngzj\" (UID: \"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:55:58.956307 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.956257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4fx\" (UniqueName: \"kubernetes.io/projected/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6-kube-api-access-fw4fx\") pod \"limitador-operator-controller-manager-74495c69f8-pngzj\" (UID: \"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:55:58.970698 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:58.970669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4fx\" (UniqueName: \"kubernetes.io/projected/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6-kube-api-access-fw4fx\") pod \"limitador-operator-controller-manager-74495c69f8-pngzj\" (UID: \"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:55:59.123058 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:59.122980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:55:59.407563 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:55:59.407531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"]
Sep 20 00:55:59.409873 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:55:59.409843    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7fcd6f_f270_4bf2_af57_3d8d6621e3a6.slice/crio-92f821c0baaf9e55969e944524d48639b375ebdb1af2ded520119fdf0669ca72 WatchSource:0}: Error finding container 92f821c0baaf9e55969e944524d48639b375ebdb1af2ded520119fdf0669ca72: Status 404 returned error can't find the container with id 92f821c0baaf9e55969e944524d48639b375ebdb1af2ded520119fdf0669ca72
Sep 20 00:56:00.372175 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:00.372136    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj" event={"ID":"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6","Type":"ContainerStarted","Data":"92f821c0baaf9e55969e944524d48639b375ebdb1af2ded520119fdf0669ca72"}
Sep 20 00:56:01.379531 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:01.379445    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k" event={"ID":"afcd0ea1-29d9-4ffa-befd-877221ee1ad2","Type":"ContainerStarted","Data":"e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2"}
Sep 20 00:56:01.379910 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:01.379570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:01.399820 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:01.399772    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k" podStartSLOduration=1.372486066 podStartE2EDuration="5.399756869s" totalImagesPullingTime="4.027270803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:01.39829741 +0000 UTC m=+517.647799214" watchObservedRunningTime="2026-09-20 00:56:01.399756869 +0000 UTC m=+517.649258680"
Sep 20 00:56:02.385939 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:02.385833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj" event={"ID":"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6","Type":"ContainerStarted","Data":"945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e"}
Sep 20 00:56:02.386340 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:02.386123    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:02.405735 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:02.405692    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj" podStartSLOduration=1.7036575090000001 podStartE2EDuration="4.405677348s" totalImagesPullingTime="2.702019839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:02.404480639 +0000 UTC m=+518.653982454" watchObservedRunningTime="2026-09-20 00:56:02.405677348 +0000 UTC m=+518.655179152"
Sep 20 00:56:03.786228 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.786196    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"]
Sep 20 00:56:03.789834 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.789811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:03.791956 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.791929    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 20 00:56:03.792049 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.791972    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5h6tm\""
Sep 20 00:56:03.792049 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.791976    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 20 00:56:03.799143 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.799122    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"]
Sep 20 00:56:03.901556 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.901494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32cb371a-6f44-413e-81a5-bb61ab97d41e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:03.901556 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.901533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32cb371a-6f44-413e-81a5-bb61ab97d41e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:03.901812 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:03.901614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdb5s\" (UniqueName: \"kubernetes.io/projected/32cb371a-6f44-413e-81a5-bb61ab97d41e-kube-api-access-tdb5s\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.002910 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.002877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32cb371a-6f44-413e-81a5-bb61ab97d41e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.002910 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.002911    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32cb371a-6f44-413e-81a5-bb61ab97d41e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.003188 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.002968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdb5s\" (UniqueName: \"kubernetes.io/projected/32cb371a-6f44-413e-81a5-bb61ab97d41e-kube-api-access-tdb5s\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.003188 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:04.003111    2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 20 00:56:04.003188 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:04.003190    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cb371a-6f44-413e-81a5-bb61ab97d41e-plugin-serving-cert podName:32cb371a-6f44-413e-81a5-bb61ab97d41e nodeName:}" failed. No retries permitted until 2026-09-20 00:56:04.503168174 +0000 UTC m=+520.752669962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/32cb371a-6f44-413e-81a5-bb61ab97d41e-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6ls25" (UID: "32cb371a-6f44-413e-81a5-bb61ab97d41e") : secret "plugin-serving-cert" not found
Sep 20 00:56:04.003687 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.003659    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32cb371a-6f44-413e-81a5-bb61ab97d41e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.011402 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.011378    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdb5s\" (UniqueName: \"kubernetes.io/projected/32cb371a-6f44-413e-81a5-bb61ab97d41e-kube-api-access-tdb5s\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.336702 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.336668    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-klgcg"
Sep 20 00:56:04.506780 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.506739    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32cb371a-6f44-413e-81a5-bb61ab97d41e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.509120 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.509090    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32cb371a-6f44-413e-81a5-bb61ab97d41e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6ls25\" (UID: \"32cb371a-6f44-413e-81a5-bb61ab97d41e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.699703 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.699669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"
Sep 20 00:56:04.976807 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:04.976776    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25"]
Sep 20 00:56:04.978733 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:56:04.978705    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32cb371a_6f44_413e_81a5_bb61ab97d41e.slice/crio-9648bdbae1254137d3ea2d31d01047b7a81237052409e20206d84b16be480845 WatchSource:0}: Error finding container 9648bdbae1254137d3ea2d31d01047b7a81237052409e20206d84b16be480845: Status 404 returned error can't find the container with id 9648bdbae1254137d3ea2d31d01047b7a81237052409e20206d84b16be480845
Sep 20 00:56:05.405403 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:05.405317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25" event={"ID":"32cb371a-6f44-413e-81a5-bb61ab97d41e","Type":"ContainerStarted","Data":"9648bdbae1254137d3ea2d31d01047b7a81237052409e20206d84b16be480845"}
Sep 20 00:56:06.349032 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:06.349004    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-kk8dm"
Sep 20 00:56:11.447065 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:11.447023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25" event={"ID":"32cb371a-6f44-413e-81a5-bb61ab97d41e","Type":"ContainerStarted","Data":"2aed1deb2c0de09b6d974471cc322978f05a15bd3d189beea7d6fec7b28b5d6f"}
Sep 20 00:56:11.462472 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:11.462408    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6ls25" podStartSLOduration=2.386851967 podStartE2EDuration="8.462390526s" totalImagesPullingTime="6.075538559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:11.460574117 +0000 UTC m=+527.710075920" watchObservedRunningTime="2026-09-20 00:56:11.462390526 +0000 UTC m=+527.711892329"
Sep 20 00:56:12.388066 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:12.388031    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:13.395853 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.395819    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:13.567234 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.567197    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"]
Sep 20 00:56:13.572475 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.572459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:13.597604 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.597576    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"]
Sep 20 00:56:13.688442 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.688414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh4vt\" (UniqueName: \"kubernetes.io/projected/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-kube-api-access-vh4vt\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:13.688585 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.688473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:13.770741 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.770707    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"]
Sep 20 00:56:13.770975 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:13.770957    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vh4vt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt" podUID="fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4"
Sep 20 00:56:13.789561 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.789527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh4vt\" (UniqueName: \"kubernetes.io/projected/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-kube-api-access-vh4vt\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:13.789697 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.789611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:13.790033 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.790013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:13.810427 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:13.810401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh4vt\" (UniqueName: \"kubernetes.io/projected/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-kube-api-access-vh4vt\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:14.462745 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.462714    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:14.470027 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.470006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:14.513667 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.513641    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"]
Sep 20 00:56:14.525551 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.525524    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"]
Sep 20 00:56:14.541719 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.541688    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"]
Sep 20 00:56:14.541907 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.541886    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" containerName="manager" containerID="cri-o://e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2" gracePeriod=2
Sep 20 00:56:14.549563 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.549533    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"]
Sep 20 00:56:14.566185 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.566159    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"]
Sep 20 00:56:14.566360 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.566336    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" containerName="manager" containerID="cri-o://945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e" gracePeriod=2
Sep 20 00:56:14.568319 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.568184    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:14.571378 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.571338    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:14.573967 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.573945    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"]
Sep 20 00:56:14.574328 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.574314    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" containerName="manager"
Sep 20 00:56:14.574370 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.574331    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" containerName="manager"
Sep 20 00:56:14.574413 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.574402    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" containerName="manager"
Sep 20 00:56:14.577595 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.577574    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"]
Sep 20 00:56:14.577692 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.577679    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.579891 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.579854    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:14.589833 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.589802    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"]
Sep 20 00:56:14.596607 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.596589    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh4vt\" (UniqueName: \"kubernetes.io/projected/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-kube-api-access-vh4vt\") pod \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") "
Sep 20 00:56:14.596706 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.596677    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-extensions-socket-volume\") pod \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\" (UID: \"fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4\") "
Sep 20 00:56:14.596959 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.596935    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4" (UID: "fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:56:14.598876 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.598849    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-kube-api-access-vh4vt" (OuterVolumeSpecName: "kube-api-access-vh4vt") pod "fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4" (UID: "fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4"). InnerVolumeSpecName "kube-api-access-vh4vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:56:14.602083 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.602062    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"]
Sep 20 00:56:14.602442 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.602427    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" containerName="manager"
Sep 20 00:56:14.602529 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.602443    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" containerName="manager"
Sep 20 00:56:14.602584 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.602556    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" containerName="manager"
Sep 20 00:56:14.604521 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.604492    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:14.605853 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.605837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:14.607418 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.607391    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:14.618348 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.618326    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"]
Sep 20 00:56:14.634722 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.634694    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:14.697759 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.697712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2xj6\" (UniqueName: \"kubernetes.io/projected/43445d31-f5d2-4753-99df-a053ef1f0405-kube-api-access-t2xj6\") pod \"limitador-operator-controller-manager-74495c69f8-dxrlj\" (UID: \"43445d31-f5d2-4753-99df-a053ef1f0405\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:14.697945 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.697782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzf7r\" (UniqueName: \"kubernetes.io/projected/2684d49b-5bcd-4104-a61e-4e8f307c5265-kube-api-access-xzf7r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ntpmc\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.697945 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.697847    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2684d49b-5bcd-4104-a61e-4e8f307c5265-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ntpmc\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.698052 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.698003    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh4vt\" (UniqueName: \"kubernetes.io/projected/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-kube-api-access-vh4vt\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:14.698052 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.698032    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4-extensions-socket-volume\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:14.798507 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.798478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2xj6\" (UniqueName: \"kubernetes.io/projected/43445d31-f5d2-4753-99df-a053ef1f0405-kube-api-access-t2xj6\") pod \"limitador-operator-controller-manager-74495c69f8-dxrlj\" (UID: \"43445d31-f5d2-4753-99df-a053ef1f0405\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:14.798624 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.798537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzf7r\" (UniqueName: \"kubernetes.io/projected/2684d49b-5bcd-4104-a61e-4e8f307c5265-kube-api-access-xzf7r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ntpmc\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.798624 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.798581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2684d49b-5bcd-4104-a61e-4e8f307c5265-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ntpmc\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.798992 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.798972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2684d49b-5bcd-4104-a61e-4e8f307c5265-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ntpmc\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.802155 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.802137    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:14.803886 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.803862    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:14.804696 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.804681    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:14.808473 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.808450    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:14.809889 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.809866    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:14.811397 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:14.811366    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:14.811815 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.811797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2xj6\" (UniqueName: \"kubernetes.io/projected/43445d31-f5d2-4753-99df-a053ef1f0405-kube-api-access-t2xj6\") pod \"limitador-operator-controller-manager-74495c69f8-dxrlj\" (UID: \"43445d31-f5d2-4753-99df-a053ef1f0405\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:14.812250 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.812233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzf7r\" (UniqueName: \"kubernetes.io/projected/2684d49b-5bcd-4104-a61e-4e8f307c5265-kube-api-access-xzf7r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ntpmc\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.899581 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.899544    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbsls\" (UniqueName: \"kubernetes.io/projected/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-kube-api-access-nbsls\") pod \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") "
Sep 20 00:56:14.899736 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.899634    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-extensions-socket-volume\") pod \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\" (UID: \"afcd0ea1-29d9-4ffa-befd-877221ee1ad2\") "
Sep 20 00:56:14.899736 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.899679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw4fx\" (UniqueName: \"kubernetes.io/projected/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6-kube-api-access-fw4fx\") pod \"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6\" (UID: \"4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6\") "
Sep 20 00:56:14.900177 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.900151    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "afcd0ea1-29d9-4ffa-befd-877221ee1ad2" (UID: "afcd0ea1-29d9-4ffa-befd-877221ee1ad2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:56:14.901882 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.901858    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-kube-api-access-nbsls" (OuterVolumeSpecName: "kube-api-access-nbsls") pod "afcd0ea1-29d9-4ffa-befd-877221ee1ad2" (UID: "afcd0ea1-29d9-4ffa-befd-877221ee1ad2"). InnerVolumeSpecName "kube-api-access-nbsls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:56:14.901991 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.901904    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6-kube-api-access-fw4fx" (OuterVolumeSpecName: "kube-api-access-fw4fx") pod "4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" (UID: "4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6"). InnerVolumeSpecName "kube-api-access-fw4fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:56:14.968332 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.968291    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:14.974541 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:14.974513    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:15.000871 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.000836    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw4fx\" (UniqueName: \"kubernetes.io/projected/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6-kube-api-access-fw4fx\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:15.001023 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.000873    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbsls\" (UniqueName: \"kubernetes.io/projected/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-kube-api-access-nbsls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:15.001023 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.000890    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afcd0ea1-29d9-4ffa-befd-877221ee1ad2-extensions-socket-volume\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:15.259193 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.259167    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"]
Sep 20 00:56:15.260932 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:56:15.260892    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2684d49b_5bcd_4104_a61e_4e8f307c5265.slice/crio-2e5470ddf0e61877f8c651afacba6ffc0b5c24b65017311f6fe5dc84f737a583 WatchSource:0}: Error finding container 2e5470ddf0e61877f8c651afacba6ffc0b5c24b65017311f6fe5dc84f737a583: Status 404 returned error can't find the container with id 2e5470ddf0e61877f8c651afacba6ffc0b5c24b65017311f6fe5dc84f737a583
Sep 20 00:56:15.268965 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.268942    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"]
Sep 20 00:56:15.271644 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:56:15.271623    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43445d31_f5d2_4753_99df_a053ef1f0405.slice/crio-742845ec00516b8993c2659a78f5d835c3afc0822546f959c6b367806b7e22c6 WatchSource:0}: Error finding container 742845ec00516b8993c2659a78f5d835c3afc0822546f959c6b367806b7e22c6: Status 404 returned error can't find the container with id 742845ec00516b8993c2659a78f5d835c3afc0822546f959c6b367806b7e22c6
Sep 20 00:56:15.470251 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.470220    2568 generic.go:356] "Generic (PLEG): container finished" podID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" containerID="945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e" exitCode=0
Sep 20 00:56:15.470695 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.470275    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:15.470695 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.470326    2568 scope.go:117] "RemoveContainer" containerID="945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e"
Sep 20 00:56:15.472125 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.472089    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:15.472658 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.472621    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc" event={"ID":"2684d49b-5bcd-4104-a61e-4e8f307c5265","Type":"ContainerStarted","Data":"af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4"}
Sep 20 00:56:15.472757 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.472690    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc" event={"ID":"2684d49b-5bcd-4104-a61e-4e8f307c5265","Type":"ContainerStarted","Data":"2e5470ddf0e61877f8c651afacba6ffc0b5c24b65017311f6fe5dc84f737a583"}
Sep 20 00:56:15.472757 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.472724    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:15.473515 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.473488    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:15.474448 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.474427    2568 generic.go:356] "Generic (PLEG): container finished" podID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" containerID="e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2" exitCode=0
Sep 20 00:56:15.474574 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.474470    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:15.476516 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.476501    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:15.476625 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.476536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj" event={"ID":"43445d31-f5d2-4753-99df-a053ef1f0405","Type":"ContainerStarted","Data":"38e830a6bc983cbf1ffc8fc29ee4b5d4cf5f0bef36536ea61cee21ed7a21511e"}
Sep 20 00:56:15.476625 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.476573    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj" event={"ID":"43445d31-f5d2-4753-99df-a053ef1f0405","Type":"ContainerStarted","Data":"742845ec00516b8993c2659a78f5d835c3afc0822546f959c6b367806b7e22c6"}
Sep 20 00:56:15.476736 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.476691    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:15.481751 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.481729    2568 scope.go:117] "RemoveContainer" containerID="945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e"
Sep 20 00:56:15.482093 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.482069    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e\": container with ID starting with 945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e not found: ID does not exist" containerID="945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e"
Sep 20 00:56:15.482163 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.482105    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e"} err="failed to get container status \"945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e\": rpc error: code = NotFound desc = could not find container \"945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e\": container with ID starting with 945084821c9bbe2ba8f04406242420a9f1ea0e278ddacbcc9d81c227ce9c5d1e not found: ID does not exist"
Sep 20 00:56:15.482163 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.482129    2568 scope.go:117] "RemoveContainer" containerID="e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2"
Sep 20 00:56:15.492779 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.492762    2568 scope.go:117] "RemoveContainer" containerID="e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2"
Sep 20 00:56:15.493058 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.493035    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2\": container with ID starting with e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2 not found: ID does not exist" containerID="e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2"
Sep 20 00:56:15.493145 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.493060    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2"} err="failed to get container status \"e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2\": rpc error: code = NotFound desc = could not find container \"e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2\": container with ID starting with e66ff2b20aa0099fca8955460fafb6240b8aadd9f40fa711d9e2e80f1585c4e2 not found: ID does not exist"
Sep 20 00:56:15.509083 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.508987    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:15.510109 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.510069    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc" podStartSLOduration=1.5100555500000001 podStartE2EDuration="1.51005555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:15.507087496 +0000 UTC m=+531.756589300" watchObservedRunningTime="2026-09-20 00:56:15.51005555 +0000 UTC m=+531.759557353"
Sep 20 00:56:15.511676 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.511650    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:15.513583 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.513561    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:15.514986 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.514968    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:15.516364 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.516343    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:15.543230 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.543174    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj" podStartSLOduration=1.5431523029999998 podStartE2EDuration="1.543152303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:15.542038825 +0000 UTC m=+531.791540629" watchObservedRunningTime="2026-09-20 00:56:15.543152303 +0000 UTC m=+531.792654108"
Sep 20 00:56:15.984554 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.984519    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-h8gbt\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-h8gbt"
Sep 20 00:56:15.985885 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.985859    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pfg6k\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pfg6k"
Sep 20 00:56:15.987246 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:15.987221    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pngzj\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pngzj"
Sep 20 00:56:15.987631 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.987611    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6" path="/var/lib/kubelet/pods/4a7fcd6f-f270-4bf2-af57-3d8d6621e3a6/volumes"
Sep 20 00:56:15.987980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.987967    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afcd0ea1-29d9-4ffa-befd-877221ee1ad2" path="/var/lib/kubelet/pods/afcd0ea1-29d9-4ffa-befd-877221ee1ad2/volumes"
Sep 20 00:56:15.988277 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:15.988266    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4" path="/var/lib/kubelet/pods/fb5ea8c8-120d-4edd-8c0d-0c0b7a57aab4/volumes"
Sep 20 00:56:26.486761 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:26.486730    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:26.487181 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:26.486806    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dxrlj"
Sep 20 00:56:29.617066 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:29.617031    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"]
Sep 20 00:56:29.617514 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:29.617253    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc" podUID="2684d49b-5bcd-4104-a61e-4e8f307c5265" containerName="manager" containerID="cri-o://af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4" gracePeriod=10
Sep 20 00:56:29.861143 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:29.861117    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"]
Sep 20 00:56:29.864381 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:29.864358    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:29.865366 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:29.865350    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:29.880346 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:29.880320    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"]
Sep 20 00:56:30.030789 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.030750    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2684d49b-5bcd-4104-a61e-4e8f307c5265-extensions-socket-volume\") pod \"2684d49b-5bcd-4104-a61e-4e8f307c5265\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") "
Sep 20 00:56:30.030999 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.030834    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzf7r\" (UniqueName: \"kubernetes.io/projected/2684d49b-5bcd-4104-a61e-4e8f307c5265-kube-api-access-xzf7r\") pod \"2684d49b-5bcd-4104-a61e-4e8f307c5265\" (UID: \"2684d49b-5bcd-4104-a61e-4e8f307c5265\") "
Sep 20 00:56:30.030999 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.030984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnf84\" (UniqueName: \"kubernetes.io/projected/1a7551ec-27ab-43e5-a675-c627df0bf4b4-kube-api-access-rnf84\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kt7cj\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.031122 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.031025    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a7551ec-27ab-43e5-a675-c627df0bf4b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kt7cj\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.031177 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.031153    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2684d49b-5bcd-4104-a61e-4e8f307c5265-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2684d49b-5bcd-4104-a61e-4e8f307c5265" (UID: "2684d49b-5bcd-4104-a61e-4e8f307c5265"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:56:30.032903 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.032875    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2684d49b-5bcd-4104-a61e-4e8f307c5265-kube-api-access-xzf7r" (OuterVolumeSpecName: "kube-api-access-xzf7r") pod "2684d49b-5bcd-4104-a61e-4e8f307c5265" (UID: "2684d49b-5bcd-4104-a61e-4e8f307c5265"). InnerVolumeSpecName "kube-api-access-xzf7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:56:30.132493 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.132404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnf84\" (UniqueName: \"kubernetes.io/projected/1a7551ec-27ab-43e5-a675-c627df0bf4b4-kube-api-access-rnf84\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kt7cj\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.132493 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.132480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a7551ec-27ab-43e5-a675-c627df0bf4b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kt7cj\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.132655 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.132566    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzf7r\" (UniqueName: \"kubernetes.io/projected/2684d49b-5bcd-4104-a61e-4e8f307c5265-kube-api-access-xzf7r\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:30.132655 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.132581    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2684d49b-5bcd-4104-a61e-4e8f307c5265-extensions-socket-volume\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:56:30.132904 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.132881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a7551ec-27ab-43e5-a675-c627df0bf4b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kt7cj\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.139971 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.139944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnf84\" (UniqueName: \"kubernetes.io/projected/1a7551ec-27ab-43e5-a675-c627df0bf4b4-kube-api-access-rnf84\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kt7cj\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.174987 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.174960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.448489 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.448462    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"]
Sep 20 00:56:30.449702 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:56:30.449679    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7551ec_27ab_43e5_a675_c627df0bf4b4.slice/crio-6750bba3c64cd47cb56a309126469b2d52945cb9a83d56ca070c6a9cd9910d79 WatchSource:0}: Error finding container 6750bba3c64cd47cb56a309126469b2d52945cb9a83d56ca070c6a9cd9910d79: Status 404 returned error can't find the container with id 6750bba3c64cd47cb56a309126469b2d52945cb9a83d56ca070c6a9cd9910d79
Sep 20 00:56:30.561805 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.561769    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" event={"ID":"1a7551ec-27ab-43e5-a675-c627df0bf4b4","Type":"ContainerStarted","Data":"5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"}
Sep 20 00:56:30.561964 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.561836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" event={"ID":"1a7551ec-27ab-43e5-a675-c627df0bf4b4","Type":"ContainerStarted","Data":"6750bba3c64cd47cb56a309126469b2d52945cb9a83d56ca070c6a9cd9910d79"}
Sep 20 00:56:30.562015 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.561976    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:56:30.563195 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.563172    2568 generic.go:356] "Generic (PLEG): container finished" podID="2684d49b-5bcd-4104-a61e-4e8f307c5265" containerID="af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4" exitCode=0
Sep 20 00:56:30.563324 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.563209    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc" event={"ID":"2684d49b-5bcd-4104-a61e-4e8f307c5265","Type":"ContainerDied","Data":"af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4"}
Sep 20 00:56:30.563324 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.563217    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"
Sep 20 00:56:30.563324 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.563238    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc" event={"ID":"2684d49b-5bcd-4104-a61e-4e8f307c5265","Type":"ContainerDied","Data":"2e5470ddf0e61877f8c651afacba6ffc0b5c24b65017311f6fe5dc84f737a583"}
Sep 20 00:56:30.563324 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.563258    2568 scope.go:117] "RemoveContainer" containerID="af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4"
Sep 20 00:56:30.572346 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.572331    2568 scope.go:117] "RemoveContainer" containerID="af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4"
Sep 20 00:56:30.572618 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:56:30.572600    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4\": container with ID starting with af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4 not found: ID does not exist" containerID="af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4"
Sep 20 00:56:30.572672 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.572627    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4"} err="failed to get container status \"af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4\": rpc error: code = NotFound desc = could not find container \"af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4\": container with ID starting with af3bbd7721a40957637a7bbd6c38255ea8644682989ecdc321e3f673acab6fe4 not found: ID does not exist"
Sep 20 00:56:30.580084 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.580043    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" podStartSLOduration=1.580031551 podStartE2EDuration="1.580031551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:30.578849503 +0000 UTC m=+546.828351308" watchObservedRunningTime="2026-09-20 00:56:30.580031551 +0000 UTC m=+546.829533355"
Sep 20 00:56:30.601368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.601342    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"]
Sep 20 00:56:30.608092 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:30.608068    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ntpmc"]
Sep 20 00:56:31.986708 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:31.986677    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2684d49b-5bcd-4104-a61e-4e8f307c5265" path="/var/lib/kubelet/pods/2684d49b-5bcd-4104-a61e-4e8f307c5265/volumes"
Sep 20 00:56:41.572154 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:56:41.572122    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 00:57:00.016597 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.016557    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:00.017064 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.016899    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2684d49b-5bcd-4104-a61e-4e8f307c5265" containerName="manager"
Sep 20 00:57:00.017064 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.016910    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2684d49b-5bcd-4104-a61e-4e8f307c5265" containerName="manager"
Sep 20 00:57:00.017064 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.016999    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2684d49b-5bcd-4104-a61e-4e8f307c5265" containerName="manager"
Sep 20 00:57:00.038368 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.038329    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:00.038560 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.038382    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.040630 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.040603    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 20 00:57:00.078981 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.078948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5429c3ac-2492-42ab-9184-1d557903feca-config-file\") pod \"limitador-limitador-8588749977-z2jr4\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") " pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.079166 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.078994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbt9\" (UniqueName: \"kubernetes.io/projected/5429c3ac-2492-42ab-9184-1d557903feca-kube-api-access-2fbt9\") pod \"limitador-limitador-8588749977-z2jr4\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") " pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.123765 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.123717    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:00.180571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.180531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5429c3ac-2492-42ab-9184-1d557903feca-config-file\") pod \"limitador-limitador-8588749977-z2jr4\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") " pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.180571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.180573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbt9\" (UniqueName: \"kubernetes.io/projected/5429c3ac-2492-42ab-9184-1d557903feca-kube-api-access-2fbt9\") pod \"limitador-limitador-8588749977-z2jr4\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") " pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.181230 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.181209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5429c3ac-2492-42ab-9184-1d557903feca-config-file\") pod \"limitador-limitador-8588749977-z2jr4\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") " pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.188308 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.188275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbt9\" (UniqueName: \"kubernetes.io/projected/5429c3ac-2492-42ab-9184-1d557903feca-kube-api-access-2fbt9\") pod \"limitador-limitador-8588749977-z2jr4\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") " pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.349899 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.349804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:00.621645 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.621615    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:00.623474 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:57:00.623445    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5429c3ac_2492_42ab_9184_1d557903feca.slice/crio-9269d4a0cecc495dc9af25340211afd58d280cd3e1bf22e69d83e445f590c00d WatchSource:0}: Error finding container 9269d4a0cecc495dc9af25340211afd58d280cd3e1bf22e69d83e445f590c00d: Status 404 returned error can't find the container with id 9269d4a0cecc495dc9af25340211afd58d280cd3e1bf22e69d83e445f590c00d
Sep 20 00:57:00.723870 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.723834    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4" event={"ID":"5429c3ac-2492-42ab-9184-1d557903feca","Type":"ContainerStarted","Data":"9269d4a0cecc495dc9af25340211afd58d280cd3e1bf22e69d83e445f590c00d"}
Sep 20 00:57:00.832797 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.832761    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cspzf"]
Sep 20 00:57:00.837701 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.837682    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:00.839810 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.839788    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jzqpq\""
Sep 20 00:57:00.843605 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.843584    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cspzf"]
Sep 20 00:57:00.885710 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.885635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ghn\" (UniqueName: \"kubernetes.io/projected/88ba11d0-fcdd-4c1e-954e-538267b2a7ed-kube-api-access-l6ghn\") pod \"authorino-7bcfd8f9cd-cspzf\" (UID: \"88ba11d0-fcdd-4c1e-954e-538267b2a7ed\") " pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:00.987167 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.987136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ghn\" (UniqueName: \"kubernetes.io/projected/88ba11d0-fcdd-4c1e-954e-538267b2a7ed-kube-api-access-l6ghn\") pod \"authorino-7bcfd8f9cd-cspzf\" (UID: \"88ba11d0-fcdd-4c1e-954e-538267b2a7ed\") " pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:00.995342 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:00.995311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ghn\" (UniqueName: \"kubernetes.io/projected/88ba11d0-fcdd-4c1e-954e-538267b2a7ed-kube-api-access-l6ghn\") pod \"authorino-7bcfd8f9cd-cspzf\" (UID: \"88ba11d0-fcdd-4c1e-954e-538267b2a7ed\") " pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:01.148327 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:01.148218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:01.418075 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:01.418048    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cspzf"]
Sep 20 00:57:01.420178 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:57:01.420139    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ba11d0_fcdd_4c1e_954e_538267b2a7ed.slice/crio-e2b0b158b38e9e17ced9b80f2e33b05cd65443bfe00b9faa1e367a202bb719d9 WatchSource:0}: Error finding container e2b0b158b38e9e17ced9b80f2e33b05cd65443bfe00b9faa1e367a202bb719d9: Status 404 returned error can't find the container with id e2b0b158b38e9e17ced9b80f2e33b05cd65443bfe00b9faa1e367a202bb719d9
Sep 20 00:57:01.731053 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:01.731019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf" event={"ID":"88ba11d0-fcdd-4c1e-954e-538267b2a7ed","Type":"ContainerStarted","Data":"e2b0b158b38e9e17ced9b80f2e33b05cd65443bfe00b9faa1e367a202bb719d9"}
Sep 20 00:57:03.742715 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:03.742679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf" event={"ID":"88ba11d0-fcdd-4c1e-954e-538267b2a7ed","Type":"ContainerStarted","Data":"30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7"}
Sep 20 00:57:03.757271 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:03.757227    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf" podStartSLOduration=1.80063391 podStartE2EDuration="3.757213393s" totalImagesPullingTime="1.956579483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:03.755885386 +0000 UTC m=+580.005387191" watchObservedRunningTime="2026-09-20 00:57:03.757213393 +0000 UTC m=+580.006715196"
Sep 20 00:57:03.816419 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:03.816383    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cspzf"]
Sep 20 00:57:05.754077 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:05.754039    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf" podUID="88ba11d0-fcdd-4c1e-954e-538267b2a7ed" containerName="authorino" containerID="cri-o://30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7" gracePeriod=30
Sep 20 00:57:05.996251 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:05.996227    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:06.137355 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.137272    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6ghn\" (UniqueName: \"kubernetes.io/projected/88ba11d0-fcdd-4c1e-954e-538267b2a7ed-kube-api-access-l6ghn\") pod \"88ba11d0-fcdd-4c1e-954e-538267b2a7ed\" (UID: \"88ba11d0-fcdd-4c1e-954e-538267b2a7ed\") "
Sep 20 00:57:06.139585 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.139561    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ba11d0-fcdd-4c1e-954e-538267b2a7ed-kube-api-access-l6ghn" (OuterVolumeSpecName: "kube-api-access-l6ghn") pod "88ba11d0-fcdd-4c1e-954e-538267b2a7ed" (UID: "88ba11d0-fcdd-4c1e-954e-538267b2a7ed"). InnerVolumeSpecName "kube-api-access-l6ghn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:57:06.238582 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.238549    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6ghn\" (UniqueName: \"kubernetes.io/projected/88ba11d0-fcdd-4c1e-954e-538267b2a7ed-kube-api-access-l6ghn\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:06.760807 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.760769    2568 generic.go:356] "Generic (PLEG): container finished" podID="88ba11d0-fcdd-4c1e-954e-538267b2a7ed" containerID="30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7" exitCode=0
Sep 20 00:57:06.761294 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.760814    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf"
Sep 20 00:57:06.761294 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.760857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf" event={"ID":"88ba11d0-fcdd-4c1e-954e-538267b2a7ed","Type":"ContainerDied","Data":"30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7"}
Sep 20 00:57:06.761294 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.760902    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cspzf" event={"ID":"88ba11d0-fcdd-4c1e-954e-538267b2a7ed","Type":"ContainerDied","Data":"e2b0b158b38e9e17ced9b80f2e33b05cd65443bfe00b9faa1e367a202bb719d9"}
Sep 20 00:57:06.761294 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.760933    2568 scope.go:117] "RemoveContainer" containerID="30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7"
Sep 20 00:57:06.769782 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.769764    2568 scope.go:117] "RemoveContainer" containerID="30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7"
Sep 20 00:57:06.770119 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:57:06.770099    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7\": container with ID starting with 30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7 not found: ID does not exist" containerID="30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7"
Sep 20 00:57:06.770201 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.770129    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7"} err="failed to get container status \"30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7\": rpc error: code = NotFound desc = could not find container \"30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7\": container with ID starting with 30ce1ed1de4d3f752ec5d799663a390b7b1fc3b016e0bda0ce1bb821c2f7cca7 not found: ID does not exist"
Sep 20 00:57:06.784646 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.784610    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cspzf"]
Sep 20 00:57:06.786625 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:06.786602    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cspzf"]
Sep 20 00:57:07.986592 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:07.986558    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ba11d0-fcdd-4c1e-954e-538267b2a7ed" path="/var/lib/kubelet/pods/88ba11d0-fcdd-4c1e-954e-538267b2a7ed/volumes"
Sep 20 00:57:13.820159 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:13.817652    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:18.493683 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.493641    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"]
Sep 20 00:57:18.494176 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.494160    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ba11d0-fcdd-4c1e-954e-538267b2a7ed" containerName="authorino"
Sep 20 00:57:18.494225 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.494178    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ba11d0-fcdd-4c1e-954e-538267b2a7ed" containerName="authorino"
Sep 20 00:57:18.494259 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.494235    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="88ba11d0-fcdd-4c1e-954e-538267b2a7ed" containerName="authorino"
Sep 20 00:57:18.497232 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.497212    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.499387 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.499365    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 20 00:57:18.499888 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.499872    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 20 00:57:18.499996 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.499937    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 00:57:18.499996 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.499940    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-kwpfg\""
Sep 20 00:57:18.504039 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.504018    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"]
Sep 20 00:57:18.646281 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.646244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrht\" (UniqueName: \"kubernetes.io/projected/a6c480fa-3861-4541-8e60-d2f449939248-kube-api-access-gfrht\") pod \"postgres-69fb4594cf-mltdd\" (UID: \"a6c480fa-3861-4541-8e60-d2f449939248\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.646458 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.646300    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a6c480fa-3861-4541-8e60-d2f449939248-data\") pod \"postgres-69fb4594cf-mltdd\" (UID: \"a6c480fa-3861-4541-8e60-d2f449939248\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.747053 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.746962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrht\" (UniqueName: \"kubernetes.io/projected/a6c480fa-3861-4541-8e60-d2f449939248-kube-api-access-gfrht\") pod \"postgres-69fb4594cf-mltdd\" (UID: \"a6c480fa-3861-4541-8e60-d2f449939248\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.747053 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.747030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a6c480fa-3861-4541-8e60-d2f449939248-data\") pod \"postgres-69fb4594cf-mltdd\" (UID: \"a6c480fa-3861-4541-8e60-d2f449939248\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.747449 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.747427    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a6c480fa-3861-4541-8e60-d2f449939248-data\") pod \"postgres-69fb4594cf-mltdd\" (UID: \"a6c480fa-3861-4541-8e60-d2f449939248\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.754333 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.754310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrht\" (UniqueName: \"kubernetes.io/projected/a6c480fa-3861-4541-8e60-d2f449939248-kube-api-access-gfrht\") pod \"postgres-69fb4594cf-mltdd\" (UID: \"a6c480fa-3861-4541-8e60-d2f449939248\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:18.809406 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:18.809378    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:19.088743 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:19.088706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"]
Sep 20 00:57:19.179179 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:57:19.179148    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c480fa_3861_4541_8e60_d2f449939248.slice/crio-7b3026ba4549c6e90c135326371bfeb1220b613e0dc0a20f7cc3b4dab6e67a3e WatchSource:0}: Error finding container 7b3026ba4549c6e90c135326371bfeb1220b613e0dc0a20f7cc3b4dab6e67a3e: Status 404 returned error can't find the container with id 7b3026ba4549c6e90c135326371bfeb1220b613e0dc0a20f7cc3b4dab6e67a3e
Sep 20 00:57:19.835581 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:19.835503    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4" event={"ID":"5429c3ac-2492-42ab-9184-1d557903feca","Type":"ContainerStarted","Data":"69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799"}
Sep 20 00:57:19.835581 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:19.835577    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:19.836169 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:19.835551    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4" podUID="5429c3ac-2492-42ab-9184-1d557903feca" containerName="limitador" containerID="cri-o://69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799" gracePeriod=30
Sep 20 00:57:19.837367 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:19.837306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd" event={"ID":"a6c480fa-3861-4541-8e60-d2f449939248","Type":"ContainerStarted","Data":"7b3026ba4549c6e90c135326371bfeb1220b613e0dc0a20f7cc3b4dab6e67a3e"}
Sep 20 00:57:19.851410 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:19.851355    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4" podStartSLOduration=1.24106398 podStartE2EDuration="19.851335992s" totalImagesPullingTime="18.610272012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:19.849706239 +0000 UTC m=+596.099208044" watchObservedRunningTime="2026-09-20 00:57:19.851335992 +0000 UTC m=+596.100837798"
Sep 20 00:57:20.444547 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.444292    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:20.567039 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.566997    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5429c3ac-2492-42ab-9184-1d557903feca-config-file\") pod \"5429c3ac-2492-42ab-9184-1d557903feca\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") "
Sep 20 00:57:20.567221 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.567081    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fbt9\" (UniqueName: \"kubernetes.io/projected/5429c3ac-2492-42ab-9184-1d557903feca-kube-api-access-2fbt9\") pod \"5429c3ac-2492-42ab-9184-1d557903feca\" (UID: \"5429c3ac-2492-42ab-9184-1d557903feca\") "
Sep 20 00:57:20.567433 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.567405    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5429c3ac-2492-42ab-9184-1d557903feca-config-file" (OuterVolumeSpecName: "config-file") pod "5429c3ac-2492-42ab-9184-1d557903feca" (UID: "5429c3ac-2492-42ab-9184-1d557903feca"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:57:20.569972 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.569939    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5429c3ac-2492-42ab-9184-1d557903feca-kube-api-access-2fbt9" (OuterVolumeSpecName: "kube-api-access-2fbt9") pod "5429c3ac-2492-42ab-9184-1d557903feca" (UID: "5429c3ac-2492-42ab-9184-1d557903feca"). InnerVolumeSpecName "kube-api-access-2fbt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:57:20.668404 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.668292    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fbt9\" (UniqueName: \"kubernetes.io/projected/5429c3ac-2492-42ab-9184-1d557903feca-kube-api-access-2fbt9\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:20.668404 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.668327    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5429c3ac-2492-42ab-9184-1d557903feca-config-file\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:20.846082 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.846045    2568 generic.go:356] "Generic (PLEG): container finished" podID="5429c3ac-2492-42ab-9184-1d557903feca" containerID="69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799" exitCode=0
Sep 20 00:57:20.846548 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.846097    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4"
Sep 20 00:57:20.846548 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.846136    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4" event={"ID":"5429c3ac-2492-42ab-9184-1d557903feca","Type":"ContainerDied","Data":"69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799"}
Sep 20 00:57:20.846548 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.846205    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-z2jr4" event={"ID":"5429c3ac-2492-42ab-9184-1d557903feca","Type":"ContainerDied","Data":"9269d4a0cecc495dc9af25340211afd58d280cd3e1bf22e69d83e445f590c00d"}
Sep 20 00:57:20.846548 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.846242    2568 scope.go:117] "RemoveContainer" containerID="69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799"
Sep 20 00:57:20.857487 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.857469    2568 scope.go:117] "RemoveContainer" containerID="69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799"
Sep 20 00:57:20.857822 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:57:20.857800    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799\": container with ID starting with 69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799 not found: ID does not exist" containerID="69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799"
Sep 20 00:57:20.857933 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.857830    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799"} err="failed to get container status \"69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799\": rpc error: code = NotFound desc = could not find container \"69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799\": container with ID starting with 69dd071bfbe00003d14152945e06c6b8c48842802c2926d85866bb7f26759799 not found: ID does not exist"
Sep 20 00:57:20.868960 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.868937    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:20.872112 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:20.872091    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-z2jr4"]
Sep 20 00:57:21.989067 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:21.989027    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5429c3ac-2492-42ab-9184-1d557903feca" path="/var/lib/kubelet/pods/5429c3ac-2492-42ab-9184-1d557903feca/volumes"
Sep 20 00:57:24.874989 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:24.874955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd" event={"ID":"a6c480fa-3861-4541-8e60-d2f449939248","Type":"ContainerStarted","Data":"0b90e1e09abe4c282a943c3b94026e30893f9fde3152e2dcaaa47df65c1d5698"}
Sep 20 00:57:24.875451 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:24.875072    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:24.891383 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:24.891330    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd" podStartSLOduration=2.208258189 podStartE2EDuration="6.891314721s" totalImagesPullingTime="4.683056532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:24.888768289 +0000 UTC m=+601.138270095" watchObservedRunningTime="2026-09-20 00:57:24.891314721 +0000 UTC m=+601.140816525"
Sep 20 00:57:25.975214 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:25.975188    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:57:25.975680 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:25.975542    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 00:57:30.910553 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:30.910523    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mltdd"
Sep 20 00:57:31.427271 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.427236    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-vtkpx"]
Sep 20 00:57:31.427590 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.427578    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5429c3ac-2492-42ab-9184-1d557903feca" containerName="limitador"
Sep 20 00:57:31.427635 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.427591    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5429c3ac-2492-42ab-9184-1d557903feca" containerName="limitador"
Sep 20 00:57:31.427670 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.427649    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5429c3ac-2492-42ab-9184-1d557903feca" containerName="limitador"
Sep 20 00:57:31.433553 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.433525    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:31.434310 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.434280    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-vtkpx"]
Sep 20 00:57:31.435396 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.435377    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jzqpq\""
Sep 20 00:57:31.459829 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.459798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrgk\" (UniqueName: \"kubernetes.io/projected/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1-kube-api-access-vfrgk\") pod \"authorino-557f876f69-vtkpx\" (UID: \"1a6b8d3f-de95-47f9-9b10-84e78efa5dc1\") " pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:31.496591 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.496559    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-vtkpx"]
Sep 20 00:57:31.496812 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:57:31.496792    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vfrgk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-vtkpx" podUID="1a6b8d3f-de95-47f9-9b10-84e78efa5dc1"
Sep 20 00:57:31.522513 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.522478    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-jdssg"]
Sep 20 00:57:31.526863 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.526835    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.528679 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.528663    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 20 00:57:31.533274 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.533248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-jdssg"]
Sep 20 00:57:31.560526 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.560493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f038fce1-b5da-44e7-b84c-97fd8247ad4e-tls-cert\") pod \"authorino-6d4dfc649f-jdssg\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") " pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.560665 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.560532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4z8\" (UniqueName: \"kubernetes.io/projected/f038fce1-b5da-44e7-b84c-97fd8247ad4e-kube-api-access-ct4z8\") pod \"authorino-6d4dfc649f-jdssg\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") " pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.560665 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.560566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrgk\" (UniqueName: \"kubernetes.io/projected/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1-kube-api-access-vfrgk\") pod \"authorino-557f876f69-vtkpx\" (UID: \"1a6b8d3f-de95-47f9-9b10-84e78efa5dc1\") " pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:31.567706 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.567684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrgk\" (UniqueName: \"kubernetes.io/projected/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1-kube-api-access-vfrgk\") pod \"authorino-557f876f69-vtkpx\" (UID: \"1a6b8d3f-de95-47f9-9b10-84e78efa5dc1\") " pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:31.661020 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.660983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f038fce1-b5da-44e7-b84c-97fd8247ad4e-tls-cert\") pod \"authorino-6d4dfc649f-jdssg\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") " pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.661216 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.661032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4z8\" (UniqueName: \"kubernetes.io/projected/f038fce1-b5da-44e7-b84c-97fd8247ad4e-kube-api-access-ct4z8\") pod \"authorino-6d4dfc649f-jdssg\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") " pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.662538 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.662509    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-jdssg"]
Sep 20 00:57:31.662771 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:57:31.662745    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ct4z8 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-jdssg" podUID="f038fce1-b5da-44e7-b84c-97fd8247ad4e"
Sep 20 00:57:31.663757 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.663731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f038fce1-b5da-44e7-b84c-97fd8247ad4e-tls-cert\") pod \"authorino-6d4dfc649f-jdssg\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") " pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.670591 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.670569    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4z8\" (UniqueName: \"kubernetes.io/projected/f038fce1-b5da-44e7-b84c-97fd8247ad4e-kube-api-access-ct4z8\") pod \"authorino-6d4dfc649f-jdssg\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") " pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.690187 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.690128    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-748db4ff9c-wg9hq"]
Sep 20 00:57:31.694375 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.694360    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.700059 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.700039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-748db4ff9c-wg9hq"]
Sep 20 00:57:31.762251 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.762215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldq52\" (UniqueName: \"kubernetes.io/projected/41df9930-40b7-41bb-9944-bea2c3dd169b-kube-api-access-ldq52\") pod \"authorino-748db4ff9c-wg9hq\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") " pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.762437 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.762287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41df9930-40b7-41bb-9944-bea2c3dd169b-tls-cert\") pod \"authorino-748db4ff9c-wg9hq\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") " pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.863230 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.863194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldq52\" (UniqueName: \"kubernetes.io/projected/41df9930-40b7-41bb-9944-bea2c3dd169b-kube-api-access-ldq52\") pod \"authorino-748db4ff9c-wg9hq\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") " pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.863230 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.863234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41df9930-40b7-41bb-9944-bea2c3dd169b-tls-cert\") pod \"authorino-748db4ff9c-wg9hq\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") " pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.865749 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.865729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41df9930-40b7-41bb-9944-bea2c3dd169b-tls-cert\") pod \"authorino-748db4ff9c-wg9hq\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") " pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.871295 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.871272    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldq52\" (UniqueName: \"kubernetes.io/projected/41df9930-40b7-41bb-9944-bea2c3dd169b-kube-api-access-ldq52\") pod \"authorino-748db4ff9c-wg9hq\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") " pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:31.911430 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.911400    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.911757 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.911414    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:31.919562 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.919541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:31.922139 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.922122    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:31.964170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.964092    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfrgk\" (UniqueName: \"kubernetes.io/projected/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1-kube-api-access-vfrgk\") pod \"1a6b8d3f-de95-47f9-9b10-84e78efa5dc1\" (UID: \"1a6b8d3f-de95-47f9-9b10-84e78efa5dc1\") "
Sep 20 00:57:31.964170 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.964162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f038fce1-b5da-44e7-b84c-97fd8247ad4e-tls-cert\") pod \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") "
Sep 20 00:57:31.964340 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.964187    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct4z8\" (UniqueName: \"kubernetes.io/projected/f038fce1-b5da-44e7-b84c-97fd8247ad4e-kube-api-access-ct4z8\") pod \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\" (UID: \"f038fce1-b5da-44e7-b84c-97fd8247ad4e\") "
Sep 20 00:57:31.966137 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.966110    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f038fce1-b5da-44e7-b84c-97fd8247ad4e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f038fce1-b5da-44e7-b84c-97fd8247ad4e" (UID: "f038fce1-b5da-44e7-b84c-97fd8247ad4e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:57:31.966250 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.966171    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1-kube-api-access-vfrgk" (OuterVolumeSpecName: "kube-api-access-vfrgk") pod "1a6b8d3f-de95-47f9-9b10-84e78efa5dc1" (UID: "1a6b8d3f-de95-47f9-9b10-84e78efa5dc1"). InnerVolumeSpecName "kube-api-access-vfrgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:57:31.966250 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:31.966175    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f038fce1-b5da-44e7-b84c-97fd8247ad4e-kube-api-access-ct4z8" (OuterVolumeSpecName: "kube-api-access-ct4z8") pod "f038fce1-b5da-44e7-b84c-97fd8247ad4e" (UID: "f038fce1-b5da-44e7-b84c-97fd8247ad4e"). InnerVolumeSpecName "kube-api-access-ct4z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:57:32.003989 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.003957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 00:57:32.065133 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.064827    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f038fce1-b5da-44e7-b84c-97fd8247ad4e-tls-cert\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:32.065133 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.064857    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct4z8\" (UniqueName: \"kubernetes.io/projected/f038fce1-b5da-44e7-b84c-97fd8247ad4e-kube-api-access-ct4z8\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:32.065133 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.064872    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfrgk\" (UniqueName: \"kubernetes.io/projected/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1-kube-api-access-vfrgk\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:32.276110 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.276079    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-748db4ff9c-wg9hq"]
Sep 20 00:57:32.277982 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:57:32.277945    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41df9930_40b7_41bb_9944_bea2c3dd169b.slice/crio-32ef1f91d27a12f11acf7cad4b0d5b2bfc5466fda25c8c67f02df6d1f551c924 WatchSource:0}: Error finding container 32ef1f91d27a12f11acf7cad4b0d5b2bfc5466fda25c8c67f02df6d1f551c924: Status 404 returned error can't find the container with id 32ef1f91d27a12f11acf7cad4b0d5b2bfc5466fda25c8c67f02df6d1f551c924
Sep 20 00:57:32.920406 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.920370    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vtkpx"
Sep 20 00:57:32.920891 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.920541    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-748db4ff9c-wg9hq" event={"ID":"41df9930-40b7-41bb-9944-bea2c3dd169b","Type":"ContainerStarted","Data":"0e6fc1a23faeb91235f2c0219bc4eeb3ba2f75914ab2162dc90fb29473becceb"}
Sep 20 00:57:32.920891 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.920579    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-748db4ff9c-wg9hq" event={"ID":"41df9930-40b7-41bb-9944-bea2c3dd169b","Type":"ContainerStarted","Data":"32ef1f91d27a12f11acf7cad4b0d5b2bfc5466fda25c8c67f02df6d1f551c924"}
Sep 20 00:57:32.920891 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.920870    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-jdssg"
Sep 20 00:57:32.940291 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.940225    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-748db4ff9c-wg9hq" podStartSLOduration=1.454063907 podStartE2EDuration="1.940207269s" totalImagesPullingTime="486.143362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:32.938720838 +0000 UTC m=+609.188222655" watchObservedRunningTime="2026-09-20 00:57:32.940207269 +0000 UTC m=+609.189709072"
Sep 20 00:57:32.966127 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.966092    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-vtkpx"]
Sep 20 00:57:32.971818 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.971789    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-vtkpx"]
Sep 20 00:57:32.996629 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:32.996592    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-jdssg"]
Sep 20 00:57:33.000573 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:33.000547    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-jdssg"]
Sep 20 00:57:33.987232 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:33.987201    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a6b8d3f-de95-47f9-9b10-84e78efa5dc1" path="/var/lib/kubelet/pods/1a6b8d3f-de95-47f9-9b10-84e78efa5dc1/volumes"
Sep 20 00:57:33.987599 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:33.987440    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f038fce1-b5da-44e7-b84c-97fd8247ad4e" path="/var/lib/kubelet/pods/f038fce1-b5da-44e7-b84c-97fd8247ad4e/volumes"
Sep 20 00:57:37.593353 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.593320    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c78d7666d-hbjgw"]
Sep 20 00:57:37.616090 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.616062    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c78d7666d-hbjgw"]
Sep 20 00:57:37.616238 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.616172    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.618981 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.618956    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ts75m\""
Sep 20 00:57:37.619131 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.619004    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 20 00:57:37.619131 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.618983    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 20 00:57:37.619131 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.618975    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 20 00:57:37.701726 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.701692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-metrics-certs\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.701911 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.701744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-webhook-cert\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.701911 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.701805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdbp\" (UniqueName: \"kubernetes.io/projected/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-kube-api-access-nzdbp\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.742669 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.742637    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df4664d44-v7v4q"]
Sep 20 00:57:37.745449 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.745428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.756585 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.756566    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4664d44-v7v4q"]
Sep 20 00:57:37.802606 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.802575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-metrics-certs\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.802768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.802614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d2cn\" (UniqueName: \"kubernetes.io/projected/84c4e3d3-f618-4154-8530-33bb95578e8b-kube-api-access-7d2cn\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.802768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.802647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-metrics-certs\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.802768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.802683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-webhook-cert\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.802768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.802717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-webhook-cert\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.802768 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.802764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdbp\" (UniqueName: \"kubernetes.io/projected/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-kube-api-access-nzdbp\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.805102 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.805077    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-metrics-certs\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.805218 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.805117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-webhook-cert\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.810427 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.810398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdbp\" (UniqueName: \"kubernetes.io/projected/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-kube-api-access-nzdbp\") pod \"maas-controller-c78d7666d-hbjgw\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") " pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:37.903379 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.903295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-webhook-cert\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.903532 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.903447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-metrics-certs\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.903532 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.903484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2cn\" (UniqueName: \"kubernetes.io/projected/84c4e3d3-f618-4154-8530-33bb95578e8b-kube-api-access-7d2cn\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.906361 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.906333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-metrics-certs\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.906490 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.906393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-webhook-cert\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.911300 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.911274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2cn\" (UniqueName: \"kubernetes.io/projected/84c4e3d3-f618-4154-8530-33bb95578e8b-kube-api-access-7d2cn\") pod \"maas-controller-5df4664d44-v7v4q\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") " pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:37.928005 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:37.927984    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:38.055410 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:38.055371    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:38.194859 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:38.194828    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c78d7666d-hbjgw"]
Sep 20 00:57:38.196078 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:57:38.196052    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2b42bb_4fdf_4b8c_b350_ed1f1254aeb5.slice/crio-f06d0d84a9323e218bca79852c2ad1fd688bc903a47f7f95d513a09f21f14167 WatchSource:0}: Error finding container f06d0d84a9323e218bca79852c2ad1fd688bc903a47f7f95d513a09f21f14167: Status 404 returned error can't find the container with id f06d0d84a9323e218bca79852c2ad1fd688bc903a47f7f95d513a09f21f14167
Sep 20 00:57:38.323413 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:38.323390    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4664d44-v7v4q"]
Sep 20 00:57:38.325318 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:57:38.325289    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c4e3d3_f618_4154_8530_33bb95578e8b.slice/crio-35a710eed05ba791c65a745a373e82982cbc6d721f68ae9ae01a28d1ac9f6c62 WatchSource:0}: Error finding container 35a710eed05ba791c65a745a373e82982cbc6d721f68ae9ae01a28d1ac9f6c62: Status 404 returned error can't find the container with id 35a710eed05ba791c65a745a373e82982cbc6d721f68ae9ae01a28d1ac9f6c62
Sep 20 00:57:38.960386 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:38.960347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c78d7666d-hbjgw" event={"ID":"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5","Type":"ContainerStarted","Data":"f06d0d84a9323e218bca79852c2ad1fd688bc903a47f7f95d513a09f21f14167"}
Sep 20 00:57:38.962983 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:38.962954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-v7v4q" event={"ID":"84c4e3d3-f618-4154-8530-33bb95578e8b","Type":"ContainerStarted","Data":"35a710eed05ba791c65a745a373e82982cbc6d721f68ae9ae01a28d1ac9f6c62"}
Sep 20 00:57:40.985091 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:40.985049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-v7v4q" event={"ID":"84c4e3d3-f618-4154-8530-33bb95578e8b","Type":"ContainerStarted","Data":"06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2"}
Sep 20 00:57:40.985570 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:40.985221    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:40.986617 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:40.986584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c78d7666d-hbjgw" event={"ID":"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5","Type":"ContainerStarted","Data":"0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d"}
Sep 20 00:57:40.986837 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:40.986811    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:41.007416 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:41.007365    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df4664d44-v7v4q" podStartSLOduration=1.5424127890000001 podStartE2EDuration="4.007349683s" totalImagesPullingTime="2.464936894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:41.006014529 +0000 UTC m=+617.255516334" watchObservedRunningTime="2026-09-20 00:57:41.007349683 +0000 UTC m=+617.256851486"
Sep 20 00:57:41.028444 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:41.028343    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c78d7666d-hbjgw" podStartSLOduration=1.444318897 podStartE2EDuration="4.028322268s" totalImagesPullingTime="2.584003371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:41.026831105 +0000 UTC m=+617.276332910" watchObservedRunningTime="2026-09-20 00:57:41.028322268 +0000 UTC m=+617.277824071"
Sep 20 00:57:51.993133 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:51.993102    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 00:57:51.993500 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:51.993194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:52.055221 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.055190    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c78d7666d-hbjgw"]
Sep 20 00:57:52.055454 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.055426    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c78d7666d-hbjgw" podUID="4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" containerName="manager" containerID="cri-o://0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d" gracePeriod=30
Sep 20 00:57:52.299313 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.299287    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:52.317785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.317318    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-metrics-certs\") pod \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") "
Sep 20 00:57:52.317785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.317361    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-webhook-cert\") pod \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") "
Sep 20 00:57:52.317785 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.317413    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzdbp\" (UniqueName: \"kubernetes.io/projected/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-kube-api-access-nzdbp\") pod \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\" (UID: \"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5\") "
Sep 20 00:57:52.320811 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.320703    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" (UID: "4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:57:52.321022 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.320955    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" (UID: "4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:57:52.321105 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.321046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-kube-api-access-nzdbp" (OuterVolumeSpecName: "kube-api-access-nzdbp") pod "4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" (UID: "4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5"). InnerVolumeSpecName "kube-api-access-nzdbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:57:52.418199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.418165    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:52.418199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.418193    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-webhook-cert\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:52.418199 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:52.418206    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzdbp\" (UniqueName: \"kubernetes.io/projected/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5-kube-api-access-nzdbp\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 00:57:53.062406 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.062367    2568 generic.go:356] "Generic (PLEG): container finished" podID="4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" containerID="0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d" exitCode=0
Sep 20 00:57:53.062824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.062411    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c78d7666d-hbjgw"
Sep 20 00:57:53.062824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.062421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c78d7666d-hbjgw" event={"ID":"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5","Type":"ContainerDied","Data":"0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d"}
Sep 20 00:57:53.062824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.062475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c78d7666d-hbjgw" event={"ID":"4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5","Type":"ContainerDied","Data":"f06d0d84a9323e218bca79852c2ad1fd688bc903a47f7f95d513a09f21f14167"}
Sep 20 00:57:53.062824 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.062505    2568 scope.go:117] "RemoveContainer" containerID="0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d"
Sep 20 00:57:53.071650 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.071631    2568 scope.go:117] "RemoveContainer" containerID="0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d"
Sep 20 00:57:53.071901 ip-10-0-141-21 kubenswrapper[2568]: E0920 00:57:53.071881    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d\": container with ID starting with 0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d not found: ID does not exist" containerID="0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d"
Sep 20 00:57:53.072057 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.071909    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d"} err="failed to get container status \"0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d\": rpc error: code = NotFound desc = could not find container \"0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d\": container with ID starting with 0475cc796cee526c3bdf71b786f1a71c695efe883258c7f51c4c955b6f88ae8d not found: ID does not exist"
Sep 20 00:57:53.083247 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.083223    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c78d7666d-hbjgw"]
Sep 20 00:57:53.085359 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.085340    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c78d7666d-hbjgw"]
Sep 20 00:57:53.987038 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:57:53.986997    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" path="/var/lib/kubelet/pods/4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5/volumes"
Sep 20 00:58:13.146227 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.146193    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"]
Sep 20 00:58:13.146878 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.146620    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" containerName="manager"
Sep 20 00:58:13.146878 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.146632    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" containerName="manager"
Sep 20 00:58:13.146878 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.146697    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a2b42bb-4fdf-4b8c-b350-ed1f1254aeb5" containerName="manager"
Sep 20 00:58:13.149728 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.149711    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.151752 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.151729    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 20 00:58:13.152272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.152251    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 20 00:58:13.152272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.152262    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9mf4b\""
Sep 20 00:58:13.160229 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.160200    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"]
Sep 20 00:58:13.296905 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.296871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgr8l\" (UniqueName: \"kubernetes.io/projected/14af6416-6bd5-4daa-b162-fd71f0ee7c33-kube-api-access-qgr8l\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.297089 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.296936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-metrics-certs\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.297089 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.296968    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-maas-api-tls\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.297089 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.297053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14af6416-6bd5-4daa-b162-fd71f0ee7c33-openshift-service-ca\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.397574 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.397502    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgr8l\" (UniqueName: \"kubernetes.io/projected/14af6416-6bd5-4daa-b162-fd71f0ee7c33-kube-api-access-qgr8l\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.397574 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.397546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-metrics-certs\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.397817 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.397580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-maas-api-tls\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.397817 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.397646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14af6416-6bd5-4daa-b162-fd71f0ee7c33-openshift-service-ca\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.398387 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.398366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14af6416-6bd5-4daa-b162-fd71f0ee7c33-openshift-service-ca\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.400029 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.400005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-metrics-certs\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.400156 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.400058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-maas-api-tls\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.404700 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.404676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgr8l\" (UniqueName: \"kubernetes.io/projected/14af6416-6bd5-4daa-b162-fd71f0ee7c33-kube-api-access-qgr8l\") pod \"maas-api-6bdc64f446-2wq6b\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.461227 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.461190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:13.745046 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.745011    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"]
Sep 20 00:58:13.749043 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:58:13.749012    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14af6416_6bd5_4daa_b162_fd71f0ee7c33.slice/crio-aadc8556efcf7d881e91781db74fb3f536c0d9ff63aa4aeb0f768569d3a4db53 WatchSource:0}: Error finding container aadc8556efcf7d881e91781db74fb3f536c0d9ff63aa4aeb0f768569d3a4db53: Status 404 returned error can't find the container with id aadc8556efcf7d881e91781db74fb3f536c0d9ff63aa4aeb0f768569d3a4db53
Sep 20 00:58:13.749873 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:13.749853    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:58:14.192081 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:14.192037    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" event={"ID":"14af6416-6bd5-4daa-b162-fd71f0ee7c33","Type":"ContainerStarted","Data":"aadc8556efcf7d881e91781db74fb3f536c0d9ff63aa4aeb0f768569d3a4db53"}
Sep 20 00:58:16.203848 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:16.203802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" event={"ID":"14af6416-6bd5-4daa-b162-fd71f0ee7c33","Type":"ContainerStarted","Data":"647f52c1359aa8ed9b39982db24462469a149e7f9aadf9da7ef8615414243747"}
Sep 20 00:58:16.204264 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:16.203962    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:16.221725 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:16.221680    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" podStartSLOduration=1.7859524709999999 podStartE2EDuration="3.221664933s" totalImagesPullingTime="1.435712462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:16.218763205 +0000 UTC m=+652.468265009" watchObservedRunningTime="2026-09-20 00:58:16.221664933 +0000 UTC m=+652.471166737"
Sep 20 00:58:22.214336 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:22.214306    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 00:58:30.200293 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.200253    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"]
Sep 20 00:58:30.205202 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.205178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.207463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.207434    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 20 00:58:30.207463 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.207454    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 20 00:58:30.207673 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.207479    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 20 00:58:30.207673 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.207454    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dtt4r\""
Sep 20 00:58:30.214828 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.214806    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"]
Sep 20 00:58:30.337054 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.337018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5stk\" (UniqueName: \"kubernetes.io/projected/44785001-bbb8-40bc-a00c-e2a264847de6-kube-api-access-l5stk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.337054 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.337056    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.337295 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.337137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.337295 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.337163    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.337295 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.337210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.337295 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.337253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44785001-bbb8-40bc-a00c-e2a264847de6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438063 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438091    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44785001-bbb8-40bc-a00c-e2a264847de6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5stk\" (UniqueName: \"kubernetes.io/projected/44785001-bbb8-40bc-a00c-e2a264847de6-kube-api-access-l5stk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438272 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438560 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438560 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438548    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.438641 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.438581    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.440549 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.440516    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44785001-bbb8-40bc-a00c-e2a264847de6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.440810 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.440790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44785001-bbb8-40bc-a00c-e2a264847de6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.445378 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.445348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5stk\" (UniqueName: \"kubernetes.io/projected/44785001-bbb8-40bc-a00c-e2a264847de6-kube-api-access-l5stk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk\" (UID: \"44785001-bbb8-40bc-a00c-e2a264847de6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.517290 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.517196    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:30.790393 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:30.790294    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"]
Sep 20 00:58:30.794145 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:58:30.794111    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44785001_bbb8_40bc_a00c_e2a264847de6.slice/crio-136aa2abe47e66e5fe7317c8b9ca377920645bfe66c69ffc1bfe63582bba4316 WatchSource:0}: Error finding container 136aa2abe47e66e5fe7317c8b9ca377920645bfe66c69ffc1bfe63582bba4316: Status 404 returned error can't find the container with id 136aa2abe47e66e5fe7317c8b9ca377920645bfe66c69ffc1bfe63582bba4316
Sep 20 00:58:31.287605 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:31.287545    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk" event={"ID":"44785001-bbb8-40bc-a00c-e2a264847de6","Type":"ContainerStarted","Data":"136aa2abe47e66e5fe7317c8b9ca377920645bfe66c69ffc1bfe63582bba4316"}
Sep 20 00:58:32.295118 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:32.295033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk" event={"ID":"44785001-bbb8-40bc-a00c-e2a264847de6","Type":"ContainerStarted","Data":"00f1ce9ed3b49d83af086083aeb0d12cec4052896dd4b5c6aac5a38a79af14e1"}
Sep 20 00:58:32.314623 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:32.314570    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk" podStartSLOduration=1.1389281119999999 podStartE2EDuration="2.314555403s" totalImagesPullingTime="1.175627291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:32.311351607 +0000 UTC m=+668.560853411" watchObservedRunningTime="2026-09-20 00:58:32.314555403 +0000 UTC m=+668.564057207"
Sep 20 00:58:40.517874 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:40.517837    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:40.518366 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:40.517898    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:40.529988 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:40.529969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:41.357231 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:41.357202    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk"
Sep 20 00:58:57.995568 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:57.995532    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"]
Sep 20 00:58:57.998571 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:57.998550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.000767 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.000741    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 20 00:58:58.008964 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.008940    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"]
Sep 20 00:58:58.076733 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.076700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.076887 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.076761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99179556-fa32-4f28-b101-f6f7612126ef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.076887 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.076832    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92q5c\" (UniqueName: \"kubernetes.io/projected/99179556-fa32-4f28-b101-f6f7612126ef-kube-api-access-92q5c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.077027 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.076889    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.077027 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.076940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.077027 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.076965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177351 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177536 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99179556-fa32-4f28-b101-f6f7612126ef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177536 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92q5c\" (UniqueName: \"kubernetes.io/projected/99179556-fa32-4f28-b101-f6f7612126ef-kube-api-access-92q5c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177536 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177536 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177536 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.177906 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177893    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.178006 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.178059 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.177979    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.179730 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.179695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99179556-fa32-4f28-b101-f6f7612126ef-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.180105 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.180078    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99179556-fa32-4f28-b101-f6f7612126ef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.184966 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.184911    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92q5c\" (UniqueName: \"kubernetes.io/projected/99179556-fa32-4f28-b101-f6f7612126ef-kube-api-access-92q5c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g6s4t\" (UID: \"99179556-fa32-4f28-b101-f6f7612126ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.308956 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.308853    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:58:58.581236 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:58.581204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"]
Sep 20 00:58:58.582639 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:58:58.582614    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99179556_fa32_4f28_b101_f6f7612126ef.slice/crio-57609c60ec44bcfb3775600bb8569e977c0a54d666dedfa82843686bdac60f73 WatchSource:0}: Error finding container 57609c60ec44bcfb3775600bb8569e977c0a54d666dedfa82843686bdac60f73: Status 404 returned error can't find the container with id 57609c60ec44bcfb3775600bb8569e977c0a54d666dedfa82843686bdac60f73
Sep 20 00:58:59.447416 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:59.447373    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t" event={"ID":"99179556-fa32-4f28-b101-f6f7612126ef","Type":"ContainerStarted","Data":"87f1c25aaee789aad2356e9361f18ddda437ad73a8927ed53d842e5ef12b853f"}
Sep 20 00:58:59.447850 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:59.447440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t" event={"ID":"99179556-fa32-4f28-b101-f6f7612126ef","Type":"ContainerStarted","Data":"57609c60ec44bcfb3775600bb8569e977c0a54d666dedfa82843686bdac60f73"}
Sep 20 00:58:59.465441 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:58:59.465384    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t" podStartSLOduration=2.320391901 podStartE2EDuration="2.465363331s" totalImagesPullingTime="144.97143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:59.462437335 +0000 UTC m=+695.711939139" watchObservedRunningTime="2026-09-20 00:58:59.465363331 +0000 UTC m=+695.714865135"
Sep 20 00:59:07.894853 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.894817    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"]
Sep 20 00:59:07.899980 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.899952    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:07.902404 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.902373    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 20 00:59:07.913002 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.912969    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"]
Sep 20 00:59:07.964655 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.964613    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:07.964655 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.964659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:07.964866 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.964756    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:07.964866 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.964818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:07.964866 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.964857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:07.965043 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:07.964874    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwzk\" (UniqueName: \"kubernetes.io/projected/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-kube-api-access-kgwzk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066281 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066447 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066447 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwzk\" (UniqueName: \"kubernetes.io/projected/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-kube-api-access-kgwzk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066447 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066347    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066447 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066447 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066707 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066766 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.066806 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.066768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.068639 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.068606    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.068983 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.068962    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.073677 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.073657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwzk\" (UniqueName: \"kubernetes.io/projected/9d4344f3-3470-4c09-90ce-dcb7b71c4d33-kube-api-access-kgwzk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckfp9\" (UID: \"9d4344f3-3470-4c09-90ce-dcb7b71c4d33\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.222101 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.222018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:08.309260 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.309196    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:59:08.309260 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.309253    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:59:08.321581 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.321560    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:59:08.502195 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.502169    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"]
Sep 20 00:59:08.503823 ip-10-0-141-21 kubenswrapper[2568]: W0920 00:59:08.503796    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4344f3_3470_4c09_90ce_dcb7b71c4d33.slice/crio-ec775d8329f2b9a2ae43f318953b0d4055b703ec8a64e2a497c9a70f7ff2d264 WatchSource:0}: Error finding container ec775d8329f2b9a2ae43f318953b0d4055b703ec8a64e2a497c9a70f7ff2d264: Status 404 returned error can't find the container with id ec775d8329f2b9a2ae43f318953b0d4055b703ec8a64e2a497c9a70f7ff2d264
Sep 20 00:59:08.511556 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:08.511534    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g6s4t"
Sep 20 00:59:09.510316 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:09.510275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9" event={"ID":"9d4344f3-3470-4c09-90ce-dcb7b71c4d33","Type":"ContainerStarted","Data":"c4e313ea8a290d37a12650e1ef62db28d287125ff4fc115987d7647ddde006b1"}
Sep 20 00:59:09.510790 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:09.510351    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9" event={"ID":"9d4344f3-3470-4c09-90ce-dcb7b71c4d33","Type":"ContainerStarted","Data":"ec775d8329f2b9a2ae43f318953b0d4055b703ec8a64e2a497c9a70f7ff2d264"}
Sep 20 00:59:09.531187 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:09.531125    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9" podStartSLOduration=2.360169124 podStartE2EDuration="2.531102611s" totalImagesPullingTime="170.933487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:59:09.527372964 +0000 UTC m=+705.776874766" watchObservedRunningTime="2026-09-20 00:59:09.531102611 +0000 UTC m=+705.780604417"
Sep 20 00:59:18.222373 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:18.222332    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:18.222803 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:18.222442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:18.234972 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:18.234945    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 00:59:18.572955 ip-10-0-141-21 kubenswrapper[2568]: I0920 00:59:18.572851    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckfp9"
Sep 20 01:00:31.784259 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:31.784214    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-748db4ff9c-wg9hq"]
Sep 20 01:00:31.784861 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:31.784413    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-748db4ff9c-wg9hq" podUID="41df9930-40b7-41bb-9944-bea2c3dd169b" containerName="authorino" containerID="cri-o://0e6fc1a23faeb91235f2c0219bc4eeb3ba2f75914ab2162dc90fb29473becceb" gracePeriod=30
Sep 20 01:00:31.984865 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:31.984826    2568 generic.go:356] "Generic (PLEG): container finished" podID="41df9930-40b7-41bb-9944-bea2c3dd169b" containerID="0e6fc1a23faeb91235f2c0219bc4eeb3ba2f75914ab2162dc90fb29473becceb" exitCode=0
Sep 20 01:00:31.987981 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:31.987948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-748db4ff9c-wg9hq" event={"ID":"41df9930-40b7-41bb-9944-bea2c3dd169b","Type":"ContainerDied","Data":"0e6fc1a23faeb91235f2c0219bc4eeb3ba2f75914ab2162dc90fb29473becceb"}
Sep 20 01:00:32.037354 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.037295    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 01:00:32.184811 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.184777    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41df9930-40b7-41bb-9944-bea2c3dd169b-tls-cert\") pod \"41df9930-40b7-41bb-9944-bea2c3dd169b\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") "
Sep 20 01:00:32.185044 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.184821    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldq52\" (UniqueName: \"kubernetes.io/projected/41df9930-40b7-41bb-9944-bea2c3dd169b-kube-api-access-ldq52\") pod \"41df9930-40b7-41bb-9944-bea2c3dd169b\" (UID: \"41df9930-40b7-41bb-9944-bea2c3dd169b\") "
Sep 20 01:00:32.187794 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.187763    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41df9930-40b7-41bb-9944-bea2c3dd169b-kube-api-access-ldq52" (OuterVolumeSpecName: "kube-api-access-ldq52") pod "41df9930-40b7-41bb-9944-bea2c3dd169b" (UID: "41df9930-40b7-41bb-9944-bea2c3dd169b"). InnerVolumeSpecName "kube-api-access-ldq52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:00:32.197624 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.197596    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41df9930-40b7-41bb-9944-bea2c3dd169b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "41df9930-40b7-41bb-9944-bea2c3dd169b" (UID: "41df9930-40b7-41bb-9944-bea2c3dd169b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:00:32.285700 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.285666    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41df9930-40b7-41bb-9944-bea2c3dd169b-tls-cert\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:00:32.285700 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.285696    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldq52\" (UniqueName: \"kubernetes.io/projected/41df9930-40b7-41bb-9944-bea2c3dd169b-kube-api-access-ldq52\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:00:32.991904 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.991871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-748db4ff9c-wg9hq" event={"ID":"41df9930-40b7-41bb-9944-bea2c3dd169b","Type":"ContainerDied","Data":"32ef1f91d27a12f11acf7cad4b0d5b2bfc5466fda25c8c67f02df6d1f551c924"}
Sep 20 01:00:32.992429 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.991907    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-748db4ff9c-wg9hq"
Sep 20 01:00:32.992429 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:32.991938    2568 scope.go:117] "RemoveContainer" containerID="0e6fc1a23faeb91235f2c0219bc4eeb3ba2f75914ab2162dc90fb29473becceb"
Sep 20 01:00:33.013325 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:33.013294    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-748db4ff9c-wg9hq"]
Sep 20 01:00:33.019697 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:33.019674    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-748db4ff9c-wg9hq"]
Sep 20 01:00:33.987181 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:33.987147    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41df9930-40b7-41bb-9944-bea2c3dd169b" path="/var/lib/kubelet/pods/41df9930-40b7-41bb-9944-bea2c3dd169b/volumes"
Sep 20 01:00:52.752972 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.752889    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7617-efdb12"]
Sep 20 01:00:52.753331 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.753321    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41df9930-40b7-41bb-9944-bea2c3dd169b" containerName="authorino"
Sep 20 01:00:52.753374 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.753336    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41df9930-40b7-41bb-9944-bea2c3dd169b" containerName="authorino"
Sep 20 01:00:52.753414 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.753400    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="41df9930-40b7-41bb-9944-bea2c3dd169b" containerName="authorino"
Sep 20 01:00:52.756603 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.756577    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:00:52.758584 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.758558    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6z9kv\""
Sep 20 01:00:52.764906 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.764426    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7617-efdb12"]
Sep 20 01:00:52.862065 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.862033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cndrp\" (UniqueName: \"kubernetes.io/projected/e7edbebb-942c-4b4a-9e80-387017a22d96-kube-api-access-cndrp\") pod \"test-curl-7617-efdb12\" (UID: \"e7edbebb-942c-4b4a-9e80-387017a22d96\") " pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:00:52.962898 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.962865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cndrp\" (UniqueName: \"kubernetes.io/projected/e7edbebb-942c-4b4a-9e80-387017a22d96-kube-api-access-cndrp\") pod \"test-curl-7617-efdb12\" (UID: \"e7edbebb-942c-4b4a-9e80-387017a22d96\") " pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:00:52.970605 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:52.970575    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cndrp\" (UniqueName: \"kubernetes.io/projected/e7edbebb-942c-4b4a-9e80-387017a22d96-kube-api-access-cndrp\") pod \"test-curl-7617-efdb12\" (UID: \"e7edbebb-942c-4b4a-9e80-387017a22d96\") " pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:00:53.067455 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:53.067375    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:00:53.338002 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:53.337976    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7617-efdb12"]
Sep 20 01:00:53.340076 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:00:53.340037    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7edbebb_942c_4b4a_9e80_387017a22d96.slice/crio-f85af59941e72e0e91a11a7ccab1c1a51239dfb0348d58682f994b2faa55c619 WatchSource:0}: Error finding container f85af59941e72e0e91a11a7ccab1c1a51239dfb0348d58682f994b2faa55c619: Status 404 returned error can't find the container with id f85af59941e72e0e91a11a7ccab1c1a51239dfb0348d58682f994b2faa55c619
Sep 20 01:00:54.118886 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:54.118854    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7617-efdb12" event={"ID":"e7edbebb-942c-4b4a-9e80-387017a22d96","Type":"ContainerStarted","Data":"f85af59941e72e0e91a11a7ccab1c1a51239dfb0348d58682f994b2faa55c619"}
Sep 20 01:00:55.024469 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.024432    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"]
Sep 20 01:00:55.028713 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.028690    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.031980 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.031739    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-e2e8bc-serving-cert\""
Sep 20 01:00:55.046007 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.039076    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"]
Sep 20 01:00:55.082532 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.082496    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd95df85-8225-44e0-a9cf-3ba9984a88a8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.082532 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.082542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.082772 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.082561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-metrics-certs\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.082772 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.082628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f788m\" (UniqueName: \"kubernetes.io/projected/bd95df85-8225-44e0-a9cf-3ba9984a88a8-kube-api-access-f788m\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.183368 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.183322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd95df85-8225-44e0-a9cf-3ba9984a88a8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.183840 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.183388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.183840 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.183416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-metrics-certs\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.183840 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.183438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f788m\" (UniqueName: \"kubernetes.io/projected/bd95df85-8225-44e0-a9cf-3ba9984a88a8-kube-api-access-f788m\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.183840 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:00:55.183499    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-serving-cert: secret "maas-api-e2e-worker-w0-e2e8bc-serving-cert" not found
Sep 20 01:00:55.183840 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:00:55.183577    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls podName:bd95df85-8225-44e0-a9cf-3ba9984a88a8 nodeName:}" failed. No retries permitted until 2026-09-20 01:00:55.68356055 +0000 UTC m=+811.933062331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls") pod "maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" (UID: "bd95df85-8225-44e0-a9cf-3ba9984a88a8") : secret "maas-api-e2e-worker-w0-e2e8bc-serving-cert" not found
Sep 20 01:00:55.184276 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.184195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd95df85-8225-44e0-a9cf-3ba9984a88a8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.186381 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.186357    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-metrics-certs\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.195042 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.195020    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f788m\" (UniqueName: \"kubernetes.io/projected/bd95df85-8225-44e0-a9cf-3ba9984a88a8-kube-api-access-f788m\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.688232 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.688188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.691187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.691161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:55.946277 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:55.946250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:56.119421 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.119383    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"]
Sep 20 01:00:56.124854 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.124828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.126961 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.126908    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-4e301e-serving-cert\""
Sep 20 01:00:56.135034 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.135008    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"]
Sep 20 01:00:56.137206 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.137179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7617-efdb12" event={"ID":"e7edbebb-942c-4b4a-9e80-387017a22d96","Type":"ContainerStarted","Data":"5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4"}
Sep 20 01:00:56.166991 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.166933    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7617-efdb12" podStartSLOduration=1.624642804 podStartE2EDuration="4.166894594s" totalImagesPullingTime="2.54225179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:56.162622882 +0000 UTC m=+812.412124687" watchObservedRunningTime="2026-09-20 01:00:56.166894594 +0000 UTC m=+812.416396403"
Sep 20 01:00:56.192309 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.192227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-metrics-certs\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.192309 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.192290    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d1a5243-69ab-44d1-a932-dee2f319c499-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.192723 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.192353    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.192723 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.192513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2b9\" (UniqueName: \"kubernetes.io/projected/0d1a5243-69ab-44d1-a932-dee2f319c499-kube-api-access-lr2b9\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.225295 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.225270    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"]
Sep 20 01:00:56.226618 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:00:56.226587    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd95df85_8225_44e0_a9cf_3ba9984a88a8.slice/crio-8bacdeb261a5d9ebb1128e990278b3ce1d3b19ad188966558a58711372052112 WatchSource:0}: Error finding container 8bacdeb261a5d9ebb1128e990278b3ce1d3b19ad188966558a58711372052112: Status 404 returned error can't find the container with id 8bacdeb261a5d9ebb1128e990278b3ce1d3b19ad188966558a58711372052112
Sep 20 01:00:56.293785 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.293758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2b9\" (UniqueName: \"kubernetes.io/projected/0d1a5243-69ab-44d1-a932-dee2f319c499-kube-api-access-lr2b9\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.293956 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.293802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-metrics-certs\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.293956 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.293827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d1a5243-69ab-44d1-a932-dee2f319c499-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.293956 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.293854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.294128 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:00:56.294028    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-serving-cert: secret "maas-api-e2e-worker-w4-4e301e-serving-cert" not found
Sep 20 01:00:56.294128 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:00:56.294102    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls podName:0d1a5243-69ab-44d1-a932-dee2f319c499 nodeName:}" failed. No retries permitted until 2026-09-20 01:00:56.794072625 +0000 UTC m=+813.043574433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls") pod "maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" (UID: "0d1a5243-69ab-44d1-a932-dee2f319c499") : secret "maas-api-e2e-worker-w4-4e301e-serving-cert" not found
Sep 20 01:00:56.294629 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.294604    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d1a5243-69ab-44d1-a932-dee2f319c499-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.296437 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.296416    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-metrics-certs\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.302616 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.302591    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2b9\" (UniqueName: \"kubernetes.io/projected/0d1a5243-69ab-44d1-a932-dee2f319c499-kube-api-access-lr2b9\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.728757 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.728709    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7617-efdb12"]
Sep 20 01:00:56.734134 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.734106    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7617-efdb12"]
Sep 20 01:00:56.798814 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.798789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.801511 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.801486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls\") pod \"maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:56.850643 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.850603    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7617-e8dcb4"]
Sep 20 01:00:56.851107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.851086    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7edbebb-942c-4b4a-9e80-387017a22d96" containerName="test-curl-7617-efdb12"
Sep 20 01:00:56.851107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.851105    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7edbebb-942c-4b4a-9e80-387017a22d96" containerName="test-curl-7617-efdb12"
Sep 20 01:00:56.851307 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.851200    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7edbebb-942c-4b4a-9e80-387017a22d96" containerName="test-curl-7617-efdb12"
Sep 20 01:00:56.854547 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.854526    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:00:56.864408 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.864385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7617-e8dcb4"]
Sep 20 01:00:56.900262 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:56.900234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9h2x\" (UniqueName: \"kubernetes.io/projected/3b39c122-b7b3-4713-937b-045d1838886e-kube-api-access-v9h2x\") pod \"test-curl-7617-e8dcb4\" (UID: \"3b39c122-b7b3-4713-937b-045d1838886e\") " pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:00:57.001575 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.001541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9h2x\" (UniqueName: \"kubernetes.io/projected/3b39c122-b7b3-4713-937b-045d1838886e-kube-api-access-v9h2x\") pod \"test-curl-7617-e8dcb4\" (UID: \"3b39c122-b7b3-4713-937b-045d1838886e\") " pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:00:57.011756 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.011729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9h2x\" (UniqueName: \"kubernetes.io/projected/3b39c122-b7b3-4713-937b-045d1838886e-kube-api-access-v9h2x\") pod \"test-curl-7617-e8dcb4\" (UID: \"3b39c122-b7b3-4713-937b-045d1838886e\") " pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:00:57.039698 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.039625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:57.153786 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.153750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" event={"ID":"bd95df85-8225-44e0-a9cf-3ba9984a88a8","Type":"ContainerStarted","Data":"e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861"}
Sep 20 01:00:57.154003 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.153814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" event={"ID":"bd95df85-8225-44e0-a9cf-3ba9984a88a8","Type":"ContainerStarted","Data":"8bacdeb261a5d9ebb1128e990278b3ce1d3b19ad188966558a58711372052112"}
Sep 20 01:00:57.154083 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:00:57.154028    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7617-efdb12" container="test-curl-7617-efdb12"
Sep 20 01:00:57.154147 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.154095    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:00:57.165412 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.165390    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:00:57.173537 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.173491    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" podStartSLOduration=2.655027183 podStartE2EDuration="3.17347642s" totalImagesPullingTime="518.449237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:57.171439994 +0000 UTC m=+813.420941800" watchObservedRunningTime="2026-09-20 01:00:57.17347642 +0000 UTC m=+813.422978285"
Sep 20 01:00:57.216249 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.216182    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"]
Sep 20 01:00:57.222777 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.222756    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.225169 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.225146    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2fd525-serving-cert\""
Sep 20 01:00:57.235143 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.234960    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"]
Sep 20 01:00:57.305028 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.304948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-metrics-certs\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.305173 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.305083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-maas-api-tls\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.305173 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.305126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.305173 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.305145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grk8l\" (UniqueName: \"kubernetes.io/projected/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-kube-api-access-grk8l\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.316101 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.316075    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"]
Sep 20 01:00:57.319531 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:00:57.319505    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1a5243_69ab_44d1_a932_dee2f319c499.slice/crio-7108fbaeff8c91d8841b970a17edab18424b411fdd39b4f619d044921911c57f WatchSource:0}: Error finding container 7108fbaeff8c91d8841b970a17edab18424b411fdd39b4f619d044921911c57f: Status 404 returned error can't find the container with id 7108fbaeff8c91d8841b970a17edab18424b411fdd39b4f619d044921911c57f
Sep 20 01:00:57.406626 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.406589    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-maas-api-tls\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.406791 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.406633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.406791 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.406744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grk8l\" (UniqueName: \"kubernetes.io/projected/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-kube-api-access-grk8l\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.406903 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.406837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-metrics-certs\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.407302 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.407280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.409111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.409090    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-maas-api-tls\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.409196 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.409165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-metrics-certs\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.414046 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.414024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grk8l\" (UniqueName: \"kubernetes.io/projected/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-kube-api-access-grk8l\") pod \"maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.441963 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.441938    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7617-e8dcb4"]
Sep 20 01:00:57.444139 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:00:57.444101    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b39c122_b7b3_4713_937b_045d1838886e.slice/crio-3e0f21939a2f19f377741e4540b41beb81975bfdbc4a8b596b15fca017f4504c WatchSource:0}: Error finding container 3e0f21939a2f19f377741e4540b41beb81975bfdbc4a8b596b15fca017f4504c: Status 404 returned error can't find the container with id 3e0f21939a2f19f377741e4540b41beb81975bfdbc4a8b596b15fca017f4504c
Sep 20 01:00:57.546207 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.546177    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:57.824106 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:57.824081    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"]
Sep 20 01:00:57.826384 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:00:57.826351    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8182c8f2_abfc_428b_bfbf_0c94bbb476c5.slice/crio-d3d0242606d2e6b260eff1048adb3d6bcf3497237bf99bdbda65ef403db54a87 WatchSource:0}: Error finding container d3d0242606d2e6b260eff1048adb3d6bcf3497237bf99bdbda65ef403db54a87: Status 404 returned error can't find the container with id d3d0242606d2e6b260eff1048adb3d6bcf3497237bf99bdbda65ef403db54a87
Sep 20 01:00:58.161606 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.161578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl" event={"ID":"8182c8f2-abfc-428b-bfbf-0c94bbb476c5","Type":"ContainerStarted","Data":"cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2"}
Sep 20 01:00:58.161721 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.161635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl" event={"ID":"8182c8f2-abfc-428b-bfbf-0c94bbb476c5","Type":"ContainerStarted","Data":"d3d0242606d2e6b260eff1048adb3d6bcf3497237bf99bdbda65ef403db54a87"}
Sep 20 01:00:58.161801 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.161744    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:00:58.163242 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.163211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" event={"ID":"0d1a5243-69ab-44d1-a932-dee2f319c499","Type":"ContainerStarted","Data":"a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4"}
Sep 20 01:00:58.163348 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.163259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" event={"ID":"0d1a5243-69ab-44d1-a932-dee2f319c499","Type":"ContainerStarted","Data":"7108fbaeff8c91d8841b970a17edab18424b411fdd39b4f619d044921911c57f"}
Sep 20 01:00:58.163348 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.163279    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:00:58.164718 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.164694    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7617-e8dcb4" event={"ID":"3b39c122-b7b3-4713-937b-045d1838886e","Type":"ContainerStarted","Data":"d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9"}
Sep 20 01:00:58.164835 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.164729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7617-e8dcb4" event={"ID":"3b39c122-b7b3-4713-937b-045d1838886e","Type":"ContainerStarted","Data":"3e0f21939a2f19f377741e4540b41beb81975bfdbc4a8b596b15fca017f4504c"}
Sep 20 01:00:58.164899 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.164861    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7617-efdb12" podUID="e7edbebb-942c-4b4a-9e80-387017a22d96" containerName="test-curl-7617-efdb12" containerID="cri-o://5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4" gracePeriod=2
Sep 20 01:00:58.178662 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.178320    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl" podStartSLOduration=0.903623349 podStartE2EDuration="1.178302749s" totalImagesPullingTime="274.6794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:58.177990851 +0000 UTC m=+814.427492668" watchObservedRunningTime="2026-09-20 01:00:58.178302749 +0000 UTC m=+814.427804554"
Sep 20 01:00:58.192027 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.191982    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7617-e8dcb4" podStartSLOduration=2.191969023 podStartE2EDuration="2.191969023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:58.190388393 +0000 UTC m=+814.439890198" watchObservedRunningTime="2026-09-20 01:00:58.191969023 +0000 UTC m=+814.441471155"
Sep 20 01:00:58.209407 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.209366    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" podStartSLOduration=1.676065088 podStartE2EDuration="2.209350379s" totalImagesPullingTime="533.285291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:58.207294719 +0000 UTC m=+814.456796540" watchObservedRunningTime="2026-09-20 01:00:58.209350379 +0000 UTC m=+814.458852207"
Sep 20 01:00:58.798607 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.798574    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7617-e8dcb4"]
Sep 20 01:00:58.803555 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:00:58.803528    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7617-e8dcb4"]
Sep 20 01:00:59.172988 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:00:59.172951    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7617-e8dcb4" container="test-curl-7617-e8dcb4"
Sep 20 01:01:00.178073 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:00.178038    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7617-e8dcb4" podUID="3b39c122-b7b3-4713-937b-045d1838886e" containerName="test-curl-7617-e8dcb4" containerID="cri-o://d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9" gracePeriod=2
Sep 20 01:01:00.343177 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:00.343150    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:01:00.432592 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:00.432563    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cndrp\" (UniqueName: \"kubernetes.io/projected/e7edbebb-942c-4b4a-9e80-387017a22d96-kube-api-access-cndrp\") pod \"e7edbebb-942c-4b4a-9e80-387017a22d96\" (UID: \"e7edbebb-942c-4b4a-9e80-387017a22d96\") "
Sep 20 01:01:00.434595 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:00.434569    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7edbebb-942c-4b4a-9e80-387017a22d96-kube-api-access-cndrp" (OuterVolumeSpecName: "kube-api-access-cndrp") pod "e7edbebb-942c-4b4a-9e80-387017a22d96" (UID: "e7edbebb-942c-4b4a-9e80-387017a22d96"). InnerVolumeSpecName "kube-api-access-cndrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:00.534276 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:00.534240    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cndrp\" (UniqueName: \"kubernetes.io/projected/e7edbebb-942c-4b4a-9e80-387017a22d96-kube-api-access-cndrp\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:01.186368 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:01.186333    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7edbebb-942c-4b4a-9e80-387017a22d96" containerID="5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4" exitCode=137
Sep 20 01:01:01.186828 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:01.186376    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:01:01.186828 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:01.186431    2568 scope.go:117] "RemoveContainer" containerID="5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4"
Sep 20 01:01:01.196977 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:01.196864    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7617-efdb12\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="e7edbebb-942c-4b4a-9e80-387017a22d96" pod="opendatahub/test-curl-7617-efdb12"
Sep 20 01:01:01.197044 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:01.196993    2568 scope.go:117] "RemoveContainer" containerID="5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4"
Sep 20 01:01:01.197271 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:01.197255    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4\": container with ID starting with 5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4 not found: ID does not exist" containerID="5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4"
Sep 20 01:01:01.197310 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:01.197277    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4"} err="failed to get container status \"5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4\": rpc error: code = NotFound desc = could not find container \"5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4\": container with ID starting with 5c6bb2203c0dd327410a7f3a70384b63780939357c7732bc22d69a8b1d0649c4 not found: ID does not exist"
Sep 20 01:01:01.988071 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:01.988033    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7edbebb-942c-4b4a-9e80-387017a22d96" path="/var/lib/kubelet/pods/e7edbebb-942c-4b4a-9e80-387017a22d96/volumes"
Sep 20 01:01:02.369189 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:02.369160    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:01:02.456843 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:02.456808    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9h2x\" (UniqueName: \"kubernetes.io/projected/3b39c122-b7b3-4713-937b-045d1838886e-kube-api-access-v9h2x\") pod \"3b39c122-b7b3-4713-937b-045d1838886e\" (UID: \"3b39c122-b7b3-4713-937b-045d1838886e\") "
Sep 20 01:01:02.459009 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:02.458978    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b39c122-b7b3-4713-937b-045d1838886e-kube-api-access-v9h2x" (OuterVolumeSpecName: "kube-api-access-v9h2x") pod "3b39c122-b7b3-4713-937b-045d1838886e" (UID: "3b39c122-b7b3-4713-937b-045d1838886e"). InnerVolumeSpecName "kube-api-access-v9h2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:02.557586 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:02.557500    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9h2x\" (UniqueName: \"kubernetes.io/projected/3b39c122-b7b3-4713-937b-045d1838886e-kube-api-access-v9h2x\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:03.170225 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.170197    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:01:03.201570 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.201537    2568 generic.go:356] "Generic (PLEG): container finished" podID="3b39c122-b7b3-4713-937b-045d1838886e" containerID="d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9" exitCode=137
Sep 20 01:01:03.201755 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.201581    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:01:03.201755 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.201643    2568 scope.go:117] "RemoveContainer" containerID="d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9"
Sep 20 01:01:03.211199 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.211178    2568 scope.go:117] "RemoveContainer" containerID="d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9"
Sep 20 01:01:03.211568 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:03.211540    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9\": container with ID starting with d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9 not found: ID does not exist" containerID="d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9"
Sep 20 01:01:03.211642 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.211581    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9"} err="failed to get container status \"d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9\": rpc error: code = NotFound desc = could not find container \"d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9\": container with ID starting with d73864ed46716925866e5fe81d21e088b5a5e28a8d3238fa55b6498e77ee64c9 not found: ID does not exist"
Sep 20 01:01:03.211887 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:03.211864    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7617-e8dcb4\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="3b39c122-b7b3-4713-937b-045d1838886e" pod="opendatahub/test-curl-7617-e8dcb4"
Sep 20 01:01:03.987283 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:03.987252    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b39c122-b7b3-4713-937b-045d1838886e" path="/var/lib/kubelet/pods/3b39c122-b7b3-4713-937b-045d1838886e/volumes"
Sep 20 01:01:04.179436 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:04.179406    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:01:04.179605 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:04.179485    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:01:06.222402 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.222366    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"]
Sep 20 01:01:06.223097 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.223076    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b39c122-b7b3-4713-937b-045d1838886e" containerName="test-curl-7617-e8dcb4"
Sep 20 01:01:06.223169 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.223101    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b39c122-b7b3-4713-937b-045d1838886e" containerName="test-curl-7617-e8dcb4"
Sep 20 01:01:06.223256 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.223243    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b39c122-b7b3-4713-937b-045d1838886e" containerName="test-curl-7617-e8dcb4"
Sep 20 01:01:06.236749 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.236718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.239154 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.239131    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-173fde-serving-cert\""
Sep 20 01:01:06.241121 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.240352    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"]
Sep 20 01:01:06.293051 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.293017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptxk\" (UniqueName: \"kubernetes.io/projected/8f59f105-ad4d-4f38-81da-1417077da125-kube-api-access-mptxk\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.293209 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.293186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-maas-api-tls\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.293261 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.293218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-metrics-certs\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.293261 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.293239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f59f105-ad4d-4f38-81da-1417077da125-openshift-service-ca\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.394426 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.394392    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mptxk\" (UniqueName: \"kubernetes.io/projected/8f59f105-ad4d-4f38-81da-1417077da125-kube-api-access-mptxk\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.394603 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.394497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-maas-api-tls\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.394603 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.394514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-metrics-certs\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.394603 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.394531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f59f105-ad4d-4f38-81da-1417077da125-openshift-service-ca\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.395224 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.395200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f59f105-ad4d-4f38-81da-1417077da125-openshift-service-ca\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.396903 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.396879    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-maas-api-tls\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.397069 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.397049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-metrics-certs\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.403514 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.403493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptxk\" (UniqueName: \"kubernetes.io/projected/8f59f105-ad4d-4f38-81da-1417077da125-kube-api-access-mptxk\") pod \"maas-api-e2e-autores-173fde-86c6d4fb8-blrt9\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.555500 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.555410    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:06.828984 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:06.828952    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"]
Sep 20 01:01:06.830620 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:01:06.830595    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f59f105_ad4d_4f38_81da_1417077da125.slice/crio-5103a7750133032d0dc54a0f3f4d404d8533c5fc9410b7ccb9601febf20bcee3 WatchSource:0}: Error finding container 5103a7750133032d0dc54a0f3f4d404d8533c5fc9410b7ccb9601febf20bcee3: Status 404 returned error can't find the container with id 5103a7750133032d0dc54a0f3f4d404d8533c5fc9410b7ccb9601febf20bcee3
Sep 20 01:01:07.228383 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.228345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9" event={"ID":"8f59f105-ad4d-4f38-81da-1417077da125","Type":"ContainerStarted","Data":"5103a7750133032d0dc54a0f3f4d404d8533c5fc9410b7ccb9601febf20bcee3"}
Sep 20 01:01:07.232758 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.232721    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"]
Sep 20 01:01:07.237908 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.237889    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.239762 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.239736    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e3070304-serving-cert\""
Sep 20 01:01:07.249323 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.249303    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"]
Sep 20 01:01:07.303613 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.303583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbbt\" (UniqueName: \"kubernetes.io/projected/7940a1af-e4d6-4787-8e50-76dc794f8d0e-kube-api-access-7sbbt\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.303768 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.303645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7940a1af-e4d6-4787-8e50-76dc794f8d0e-openshift-service-ca\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.303837 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.303768    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-metrics-certs\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.303837 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.303797    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.404508 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.404474    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-metrics-certs\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.404656 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.404521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.404656 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.404577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbbt\" (UniqueName: \"kubernetes.io/projected/7940a1af-e4d6-4787-8e50-76dc794f8d0e-kube-api-access-7sbbt\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.404656 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.404653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7940a1af-e4d6-4787-8e50-76dc794f8d0e-openshift-service-ca\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.404801 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:07.404707    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-serving-cert: secret "maas-api-e2e-ait-e3070304-serving-cert" not found
Sep 20 01:01:07.404801 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:07.404785    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls podName:7940a1af-e4d6-4787-8e50-76dc794f8d0e nodeName:}" failed. No retries permitted until 2026-09-20 01:01:07.904762734 +0000 UTC m=+824.154264538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls") pod "maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" (UID: "7940a1af-e4d6-4787-8e50-76dc794f8d0e") : secret "maas-api-e2e-ait-e3070304-serving-cert" not found
Sep 20 01:01:07.405376 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.405356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7940a1af-e4d6-4787-8e50-76dc794f8d0e-openshift-service-ca\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.406994 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.406976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-metrics-certs\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.414870 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.414844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbbt\" (UniqueName: \"kubernetes.io/projected/7940a1af-e4d6-4787-8e50-76dc794f8d0e-kube-api-access-7sbbt\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.880092 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.880057    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"]
Sep 20 01:01:07.883906 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.883888    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:07.886032 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.886012    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e3070304-dockercfg-jrwlb\""
Sep 20 01:01:07.886132 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.886016    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e3070304\""
Sep 20 01:01:07.894745 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.894719    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"]
Sep 20 01:01:07.908968 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.908907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:07.911366 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:07.911330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls\") pod \"maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:08.009519 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.009479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsshp\" (UniqueName: \"kubernetes.io/projected/6f22404d-666b-47a0-ab56-e78c26c5e94c-kube-api-access-zsshp\") pod \"payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.009681 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.009541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f22404d-666b-47a0-ab56-e78c26c5e94c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.110967 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.110927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsshp\" (UniqueName: \"kubernetes.io/projected/6f22404d-666b-47a0-ab56-e78c26c5e94c-kube-api-access-zsshp\") pod \"payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.111130 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.110992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f22404d-666b-47a0-ab56-e78c26c5e94c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.111683 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.111664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f22404d-666b-47a0-ab56-e78c26c5e94c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.118878 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.118852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsshp\" (UniqueName: \"kubernetes.io/projected/6f22404d-666b-47a0-ab56-e78c26c5e94c-kube-api-access-zsshp\") pod \"payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.156593 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.156512    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:08.196501 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.196467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:08.237949 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.237864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9" event={"ID":"8f59f105-ad4d-4f38-81da-1417077da125","Type":"ContainerStarted","Data":"92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32"}
Sep 20 01:01:08.238384 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.238002    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:08.258957 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.258886    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9" podStartSLOduration=1.7855073529999999 podStartE2EDuration="2.258869732s" totalImagesPullingTime="473.362379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:08.256983966 +0000 UTC m=+824.506485772" watchObservedRunningTime="2026-09-20 01:01:08.258869732 +0000 UTC m=+824.508371535"
Sep 20 01:01:08.429718 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.429695    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"]
Sep 20 01:01:08.430839 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:01:08.430809    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7940a1af_e4d6_4787_8e50_76dc794f8d0e.slice/crio-b306a945f6504558a212a3ace073d06efcff39e8b15e84801536eac09a912c95 WatchSource:0}: Error finding container b306a945f6504558a212a3ace073d06efcff39e8b15e84801536eac09a912c95: Status 404 returned error can't find the container with id b306a945f6504558a212a3ace073d06efcff39e8b15e84801536eac09a912c95
Sep 20 01:01:08.491715 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:08.491674    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"]
Sep 20 01:01:09.251225 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:09.250405    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m" event={"ID":"6f22404d-666b-47a0-ab56-e78c26c5e94c","Type":"ContainerStarted","Data":"41bb881ace5350ef5f21b12ddf7e09ba181625109b743f42b29be8d06d980e6e"}
Sep 20 01:01:09.252876 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:09.252842    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" event={"ID":"7940a1af-e4d6-4787-8e50-76dc794f8d0e","Type":"ContainerStarted","Data":"a0f8fe858b5315a81b4328f9961cebf89c3bf068c105eb8188d95fd3c68861a4"}
Sep 20 01:01:09.253037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:09.252900    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" event={"ID":"7940a1af-e4d6-4787-8e50-76dc794f8d0e","Type":"ContainerStarted","Data":"b306a945f6504558a212a3ace073d06efcff39e8b15e84801536eac09a912c95"}
Sep 20 01:01:09.253157 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:09.253135    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:09.284981 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:09.284906    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" podStartSLOduration=1.829893414 podStartE2EDuration="2.284887271s" totalImagesPullingTime="454.993857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:09.279367403 +0000 UTC m=+825.528869207" watchObservedRunningTime="2026-09-20 01:01:09.284887271 +0000 UTC m=+825.534389074"
Sep 20 01:01:10.263624 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:10.263577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m" event={"ID":"6f22404d-666b-47a0-ab56-e78c26c5e94c","Type":"ContainerStarted","Data":"1f41b8b8768487013ad67d93ffc6ee73750377f7bf63502e33642ab0a9393aef"}
Sep 20 01:01:10.264143 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:10.263668    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:10.279358 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:10.279310    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m" podStartSLOduration=2.056270925 podStartE2EDuration="3.279289876s" totalImagesPullingTime="1.223018951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:10.278721169 +0000 UTC m=+826.528222973" watchObservedRunningTime="2026-09-20 01:01:10.279289876 +0000 UTC m=+826.528791682"
Sep 20 01:01:14.258325 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:14.258292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:01:15.270196 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:15.270166    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:18.005172 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.005141    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"]
Sep 20 01:01:18.007978 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.007960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.010737 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.010719    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-376bcf-serving-cert\""
Sep 20 01:01:18.020746 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.020721    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"]
Sep 20 01:01:18.111091 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.111055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.111258 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.111094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ec076a-0049-46fc-81ed-6ef45bab433f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.111258 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.111118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjqw\" (UniqueName: \"kubernetes.io/projected/c8ec076a-0049-46fc-81ed-6ef45bab433f-kube-api-access-9rjqw\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.111343 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.111263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-metrics-certs\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.212060 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.212025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-metrics-certs\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.212256 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.212203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.212256 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.212249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ec076a-0049-46fc-81ed-6ef45bab433f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.212370 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:18.212327    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-serving-cert: secret "maas-api-e2e-inf-b-376bcf-serving-cert" not found
Sep 20 01:01:18.212407 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.212376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjqw\" (UniqueName: \"kubernetes.io/projected/c8ec076a-0049-46fc-81ed-6ef45bab433f-kube-api-access-9rjqw\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.212455 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:18.212407    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls podName:c8ec076a-0049-46fc-81ed-6ef45bab433f nodeName:}" failed. No retries permitted until 2026-09-20 01:01:18.712386615 +0000 UTC m=+834.961888398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls") pod "maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f") : secret "maas-api-e2e-inf-b-376bcf-serving-cert" not found
Sep 20 01:01:18.212902 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.212884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ec076a-0049-46fc-81ed-6ef45bab433f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.214611 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.214580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-metrics-certs\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.221970 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.221948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjqw\" (UniqueName: \"kubernetes.io/projected/c8ec076a-0049-46fc-81ed-6ef45bab433f-kube-api-access-9rjqw\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.717670 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:18.717626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:18.717848 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:18.717784    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-serving-cert: secret "maas-api-e2e-inf-b-376bcf-serving-cert" not found
Sep 20 01:01:18.717904 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:18.717861    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls podName:c8ec076a-0049-46fc-81ed-6ef45bab433f nodeName:}" failed. No retries permitted until 2026-09-20 01:01:19.717843957 +0000 UTC m=+835.967345739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls") pod "maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f") : secret "maas-api-e2e-inf-b-376bcf-serving-cert" not found
Sep 20 01:01:19.728573 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:19.728534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:19.729173 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:19.728715    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-serving-cert: secret "maas-api-e2e-inf-b-376bcf-serving-cert" not found
Sep 20 01:01:19.729173 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:19.728821    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls podName:c8ec076a-0049-46fc-81ed-6ef45bab433f nodeName:}" failed. No retries permitted until 2026-09-20 01:01:21.728797784 +0000 UTC m=+837.978299567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls") pod "maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f") : secret "maas-api-e2e-inf-b-376bcf-serving-cert" not found
Sep 20 01:01:21.273449 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:21.273420    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:21.749666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:21.749630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:21.752141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:21.752117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:21.919226 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:21.919192    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:22.197506 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:22.197475    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"]
Sep 20 01:01:22.198485 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:01:22.198461    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ec076a_0049_46fc_81ed_6ef45bab433f.slice/crio-0c2e417ce6da3af359d24bd2534d58333e767a5e1d1bb9ba53c01a855198b67d WatchSource:0}: Error finding container 0c2e417ce6da3af359d24bd2534d58333e767a5e1d1bb9ba53c01a855198b67d: Status 404 returned error can't find the container with id 0c2e417ce6da3af359d24bd2534d58333e767a5e1d1bb9ba53c01a855198b67d
Sep 20 01:01:22.336648 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:22.336612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" event={"ID":"c8ec076a-0049-46fc-81ed-6ef45bab433f","Type":"ContainerStarted","Data":"0c2e417ce6da3af359d24bd2534d58333e767a5e1d1bb9ba53c01a855198b67d"}
Sep 20 01:01:23.345419 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:23.345375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" event={"ID":"c8ec076a-0049-46fc-81ed-6ef45bab433f","Type":"ContainerStarted","Data":"89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa"}
Sep 20 01:01:23.345889 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:23.345544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:23.363828 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:23.363778    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" podStartSLOduration=6.075589074 podStartE2EDuration="6.363762967s" totalImagesPullingTime="288.173893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:23.362298185 +0000 UTC m=+839.611799988" watchObservedRunningTime="2026-09-20 01:01:23.363762967 +0000 UTC m=+839.613264819"
Sep 20 01:01:29.357551 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:29.357514    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:01:44.239405 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.239366    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"]
Sep 20 01:01:44.239962 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.239639    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" podUID="7940a1af-e4d6-4787-8e50-76dc794f8d0e" containerName="maas-api" containerID="cri-o://a0f8fe858b5315a81b4328f9961cebf89c3bf068c105eb8188d95fd3c68861a4" gracePeriod=30
Sep 20 01:01:44.308385 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.308351    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"]
Sep 20 01:01:44.308732 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.308701    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m" podUID="6f22404d-666b-47a0-ab56-e78c26c5e94c" containerName="payload-pre-processing" containerID="cri-o://1f41b8b8768487013ad67d93ffc6ee73750377f7bf63502e33642ab0a9393aef" gracePeriod=30
Sep 20 01:01:44.487501 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.487465    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m" event={"ID":"6f22404d-666b-47a0-ab56-e78c26c5e94c","Type":"ContainerDied","Data":"1f41b8b8768487013ad67d93ffc6ee73750377f7bf63502e33642ab0a9393aef"}
Sep 20 01:01:44.487654 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.487508    2568 generic.go:356] "Generic (PLEG): container finished" podID="6f22404d-666b-47a0-ab56-e78c26c5e94c" containerID="1f41b8b8768487013ad67d93ffc6ee73750377f7bf63502e33642ab0a9393aef" exitCode=0
Sep 20 01:01:44.489522 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.489463    2568 generic.go:356] "Generic (PLEG): container finished" podID="7940a1af-e4d6-4787-8e50-76dc794f8d0e" containerID="a0f8fe858b5315a81b4328f9961cebf89c3bf068c105eb8188d95fd3c68861a4" exitCode=0
Sep 20 01:01:44.489630 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.489531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" event={"ID":"7940a1af-e4d6-4787-8e50-76dc794f8d0e","Type":"ContainerDied","Data":"a0f8fe858b5315a81b4328f9961cebf89c3bf068c105eb8188d95fd3c68861a4"}
Sep 20 01:01:44.570423 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.570398    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:44.604138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.604114    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:44.669941 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.666559    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-metrics-certs\") pod \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") "
Sep 20 01:01:44.669941 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.666604    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsshp\" (UniqueName: \"kubernetes.io/projected/6f22404d-666b-47a0-ab56-e78c26c5e94c-kube-api-access-zsshp\") pod \"6f22404d-666b-47a0-ab56-e78c26c5e94c\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") "
Sep 20 01:01:44.669941 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.666636    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7940a1af-e4d6-4787-8e50-76dc794f8d0e-openshift-service-ca\") pod \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") "
Sep 20 01:01:44.669941 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.666672    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls\") pod \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") "
Sep 20 01:01:44.669941 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.666758    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sbbt\" (UniqueName: \"kubernetes.io/projected/7940a1af-e4d6-4787-8e50-76dc794f8d0e-kube-api-access-7sbbt\") pod \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\" (UID: \"7940a1af-e4d6-4787-8e50-76dc794f8d0e\") "
Sep 20 01:01:44.669941 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.666823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f22404d-666b-47a0-ab56-e78c26c5e94c-plugins-config-volume\") pod \"6f22404d-666b-47a0-ab56-e78c26c5e94c\" (UID: \"6f22404d-666b-47a0-ab56-e78c26c5e94c\") "
Sep 20 01:01:44.674595 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.674412    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f22404d-666b-47a0-ab56-e78c26c5e94c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f22404d-666b-47a0-ab56-e78c26c5e94c" (UID: "6f22404d-666b-47a0-ab56-e78c26c5e94c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:01:44.675315 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.675282    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7940a1af-e4d6-4787-8e50-76dc794f8d0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7940a1af-e4d6-4787-8e50-76dc794f8d0e" (UID: "7940a1af-e4d6-4787-8e50-76dc794f8d0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:01:44.677156 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.677114    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f22404d-666b-47a0-ab56-e78c26c5e94c-kube-api-access-zsshp" (OuterVolumeSpecName: "kube-api-access-zsshp") pod "6f22404d-666b-47a0-ab56-e78c26c5e94c" (UID: "6f22404d-666b-47a0-ab56-e78c26c5e94c"). InnerVolumeSpecName "kube-api-access-zsshp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:44.680812 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.680775    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7940a1af-e4d6-4787-8e50-76dc794f8d0e" (UID: "7940a1af-e4d6-4787-8e50-76dc794f8d0e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:01:44.681307 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.681274    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7940a1af-e4d6-4787-8e50-76dc794f8d0e" (UID: "7940a1af-e4d6-4787-8e50-76dc794f8d0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:01:44.690553 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.690512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7940a1af-e4d6-4787-8e50-76dc794f8d0e-kube-api-access-7sbbt" (OuterVolumeSpecName: "kube-api-access-7sbbt") pod "7940a1af-e4d6-4787-8e50-76dc794f8d0e" (UID: "7940a1af-e4d6-4787-8e50-76dc794f8d0e"). InnerVolumeSpecName "kube-api-access-7sbbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:44.775288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.775208    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f22404d-666b-47a0-ab56-e78c26c5e94c-plugins-config-volume\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:44.775288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.775241    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:44.775288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.775257    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsshp\" (UniqueName: \"kubernetes.io/projected/6f22404d-666b-47a0-ab56-e78c26c5e94c-kube-api-access-zsshp\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:44.775288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.775266    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7940a1af-e4d6-4787-8e50-76dc794f8d0e-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:44.775288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.775276    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7940a1af-e4d6-4787-8e50-76dc794f8d0e-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:44.775288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:44.775284    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sbbt\" (UniqueName: \"kubernetes.io/projected/7940a1af-e4d6-4787-8e50-76dc794f8d0e-kube-api-access-7sbbt\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:01:45.496243 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.496204    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"
Sep 20 01:01:45.496759 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.496213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m" event={"ID":"6f22404d-666b-47a0-ab56-e78c26c5e94c","Type":"ContainerDied","Data":"41bb881ace5350ef5f21b12ddf7e09ba181625109b743f42b29be8d06d980e6e"}
Sep 20 01:01:45.496759 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.496376    2568 scope.go:117] "RemoveContainer" containerID="1f41b8b8768487013ad67d93ffc6ee73750377f7bf63502e33642ab0a9393aef"
Sep 20 01:01:45.497844 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.497814    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"
Sep 20 01:01:45.497844 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.497835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w" event={"ID":"7940a1af-e4d6-4787-8e50-76dc794f8d0e","Type":"ContainerDied","Data":"b306a945f6504558a212a3ace073d06efcff39e8b15e84801536eac09a912c95"}
Sep 20 01:01:45.507766 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.507750    2568 scope.go:117] "RemoveContainer" containerID="a0f8fe858b5315a81b4328f9961cebf89c3bf068c105eb8188d95fd3c68861a4"
Sep 20 01:01:45.520134 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.520112    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"]
Sep 20 01:01:45.522780 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.522760    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m"]
Sep 20 01:01:45.531698 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.531680    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"]
Sep 20 01:01:45.540024 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.540003    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3070304-847f4bcf9-7qt8w"]
Sep 20 01:01:45.988521 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.988486    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f22404d-666b-47a0-ab56-e78c26c5e94c" path="/var/lib/kubelet/pods/6f22404d-666b-47a0-ab56-e78c26c5e94c/volumes"
Sep 20 01:01:45.988883 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:45.988871    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7940a1af-e4d6-4787-8e50-76dc794f8d0e" path="/var/lib/kubelet/pods/7940a1af-e4d6-4787-8e50-76dc794f8d0e/volumes"
Sep 20 01:01:50.128362 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.128135    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"]
Sep 20 01:01:50.128899 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.128854    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f22404d-666b-47a0-ab56-e78c26c5e94c" containerName="payload-pre-processing"
Sep 20 01:01:50.128899 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.128876    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f22404d-666b-47a0-ab56-e78c26c5e94c" containerName="payload-pre-processing"
Sep 20 01:01:50.128899 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.128890    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7940a1af-e4d6-4787-8e50-76dc794f8d0e" containerName="maas-api"
Sep 20 01:01:50.128899 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.128896    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7940a1af-e4d6-4787-8e50-76dc794f8d0e" containerName="maas-api"
Sep 20 01:01:50.129164 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.128995    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7940a1af-e4d6-4787-8e50-76dc794f8d0e" containerName="maas-api"
Sep 20 01:01:50.129164 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.129006    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f22404d-666b-47a0-ab56-e78c26c5e94c" containerName="payload-pre-processing"
Sep 20 01:01:50.132474 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.132450    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.134604 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.134585    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-816f617b-serving-cert\""
Sep 20 01:01:50.148217 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.148193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"]
Sep 20 01:01:50.232476 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.232437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.232649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.232490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17887a4c-b6c3-4fe5-8101-3dd479459c75-openshift-service-ca\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.232649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.232548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh2f8\" (UniqueName: \"kubernetes.io/projected/17887a4c-b6c3-4fe5-8101-3dd479459c75-kube-api-access-nh2f8\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.232649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.232565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-metrics-certs\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.333400 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.333371    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.333608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.333411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17887a4c-b6c3-4fe5-8101-3dd479459c75-openshift-service-ca\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.333608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.333535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh2f8\" (UniqueName: \"kubernetes.io/projected/17887a4c-b6c3-4fe5-8101-3dd479459c75-kube-api-access-nh2f8\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.333608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.333572    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-metrics-certs\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.333608 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:50.333539    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-serving-cert: secret "maas-api-e2e-migrate-816f617b-serving-cert" not found
Sep 20 01:01:50.333847 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:01:50.333684    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls podName:17887a4c-b6c3-4fe5-8101-3dd479459c75 nodeName:}" failed. No retries permitted until 2026-09-20 01:01:50.833659121 +0000 UTC m=+867.083160912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls") pod "maas-api-e2e-migrate-816f617b-657f994449-4m24v" (UID: "17887a4c-b6c3-4fe5-8101-3dd479459c75") : secret "maas-api-e2e-migrate-816f617b-serving-cert" not found
Sep 20 01:01:50.334137 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.334118    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17887a4c-b6c3-4fe5-8101-3dd479459c75-openshift-service-ca\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.336141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.336119    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-metrics-certs\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.345146 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.345120    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh2f8\" (UniqueName: \"kubernetes.io/projected/17887a4c-b6c3-4fe5-8101-3dd479459c75-kube-api-access-nh2f8\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.839016 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.838974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:50.842027 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:50.841961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls\") pod \"maas-api-e2e-migrate-816f617b-657f994449-4m24v\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:51.045315 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:51.045280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:51.322985 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:51.322957    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"]
Sep 20 01:01:51.324405 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:01:51.324374    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17887a4c_b6c3_4fe5_8101_3dd479459c75.slice/crio-2d76feeb88c6c4baa58b011baf058921161125121a21a86a01504235208613ae WatchSource:0}: Error finding container 2d76feeb88c6c4baa58b011baf058921161125121a21a86a01504235208613ae: Status 404 returned error can't find the container with id 2d76feeb88c6c4baa58b011baf058921161125121a21a86a01504235208613ae
Sep 20 01:01:51.536799 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:51.536763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v" event={"ID":"17887a4c-b6c3-4fe5-8101-3dd479459c75","Type":"ContainerStarted","Data":"2d76feeb88c6c4baa58b011baf058921161125121a21a86a01504235208613ae"}
Sep 20 01:01:52.546779 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:52.546727    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v" event={"ID":"17887a4c-b6c3-4fe5-8101-3dd479459c75","Type":"ContainerStarted","Data":"893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f"}
Sep 20 01:01:52.547293 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:52.546796    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:01:52.564470 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:52.564419    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v" podStartSLOduration=2.199084792 podStartE2EDuration="2.564404289s" totalImagesPullingTime="365.319497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:52.562601138 +0000 UTC m=+868.812102942" watchObservedRunningTime="2026-09-20 01:01:52.564404289 +0000 UTC m=+868.813906092"
Sep 20 01:01:58.559016 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:01:58.558982    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:02:19.325124 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.325039    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"]
Sep 20 01:02:19.326452 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.325984    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v" podUID="17887a4c-b6c3-4fe5-8101-3dd479459c75" containerName="maas-api" containerID="cri-o://893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f" gracePeriod=30
Sep 20 01:02:19.595105 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.595081    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:02:19.706710 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.706634    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-metrics-certs\") pod \"17887a4c-b6c3-4fe5-8101-3dd479459c75\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") "
Sep 20 01:02:19.707288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.706971    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls\") pod \"17887a4c-b6c3-4fe5-8101-3dd479459c75\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") "
Sep 20 01:02:19.707288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.707011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17887a4c-b6c3-4fe5-8101-3dd479459c75-openshift-service-ca\") pod \"17887a4c-b6c3-4fe5-8101-3dd479459c75\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") "
Sep 20 01:02:19.707288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.707102    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh2f8\" (UniqueName: \"kubernetes.io/projected/17887a4c-b6c3-4fe5-8101-3dd479459c75-kube-api-access-nh2f8\") pod \"17887a4c-b6c3-4fe5-8101-3dd479459c75\" (UID: \"17887a4c-b6c3-4fe5-8101-3dd479459c75\") "
Sep 20 01:02:19.709228 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.709192    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17887a4c-b6c3-4fe5-8101-3dd479459c75-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17887a4c-b6c3-4fe5-8101-3dd479459c75" (UID: "17887a4c-b6c3-4fe5-8101-3dd479459c75"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:19.720744 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.720704    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17887a4c-b6c3-4fe5-8101-3dd479459c75" (UID: "17887a4c-b6c3-4fe5-8101-3dd479459c75"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:02:19.723068 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.723004    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "17887a4c-b6c3-4fe5-8101-3dd479459c75" (UID: "17887a4c-b6c3-4fe5-8101-3dd479459c75"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:02:19.723658 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.723632    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17887a4c-b6c3-4fe5-8101-3dd479459c75-kube-api-access-nh2f8" (OuterVolumeSpecName: "kube-api-access-nh2f8") pod "17887a4c-b6c3-4fe5-8101-3dd479459c75" (UID: "17887a4c-b6c3-4fe5-8101-3dd479459c75"). InnerVolumeSpecName "kube-api-access-nh2f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:19.724419 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.724394    2568 generic.go:356] "Generic (PLEG): container finished" podID="17887a4c-b6c3-4fe5-8101-3dd479459c75" containerID="893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f" exitCode=0
Sep 20 01:02:19.724517 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.724433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v" event={"ID":"17887a4c-b6c3-4fe5-8101-3dd479459c75","Type":"ContainerDied","Data":"893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f"}
Sep 20 01:02:19.724517 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.724476    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"
Sep 20 01:02:19.724638 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.724521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v" event={"ID":"17887a4c-b6c3-4fe5-8101-3dd479459c75","Type":"ContainerDied","Data":"2d76feeb88c6c4baa58b011baf058921161125121a21a86a01504235208613ae"}
Sep 20 01:02:19.724638 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.724554    2568 scope.go:117] "RemoveContainer" containerID="893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f"
Sep 20 01:02:19.736438 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.736420    2568 scope.go:117] "RemoveContainer" containerID="893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f"
Sep 20 01:02:19.736788 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:02:19.736767    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f\": container with ID starting with 893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f not found: ID does not exist" containerID="893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f"
Sep 20 01:02:19.736900 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.736795    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f"} err="failed to get container status \"893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f\": rpc error: code = NotFound desc = could not find container \"893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f\": container with ID starting with 893a23764b7e7c2a5717f3c56d645fb4961e4056063de10bd4afea5853192b4f not found: ID does not exist"
Sep 20 01:02:19.767830 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.767798    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"]
Sep 20 01:02:19.770211 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.770183    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-816f617b-657f994449-4m24v"]
Sep 20 01:02:19.808637 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.808609    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh2f8\" (UniqueName: \"kubernetes.io/projected/17887a4c-b6c3-4fe5-8101-3dd479459c75-kube-api-access-nh2f8\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.808637 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.808634    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.808790 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.808644    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17887a4c-b6c3-4fe5-8101-3dd479459c75-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.808790 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.808652    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17887a4c-b6c3-4fe5-8101-3dd479459c75-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.988844 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:19.988811    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17887a4c-b6c3-4fe5-8101-3dd479459c75" path="/var/lib/kubelet/pods/17887a4c-b6c3-4fe5-8101-3dd479459c75/volumes"
Sep 20 01:02:25.010262 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.010232    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"]
Sep 20 01:02:25.010697 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.010682    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17887a4c-b6c3-4fe5-8101-3dd479459c75" containerName="maas-api"
Sep 20 01:02:25.010697 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.010698    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="17887a4c-b6c3-4fe5-8101-3dd479459c75" containerName="maas-api"
Sep 20 01:02:25.010793 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.010781    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="17887a4c-b6c3-4fe5-8101-3dd479459c75" containerName="maas-api"
Sep 20 01:02:25.013785 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.013765    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.016036 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.016016    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-083e5ca1-serving-cert\""
Sep 20 01:02:25.024813 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.024030    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"]
Sep 20 01:02:25.057851 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.057810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-metrics-certs\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.058041 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.057868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.058041 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.057940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903232b4-e460-47d2-8231-9bbc1837919f-openshift-service-ca\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.058146 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.058055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjkjd\" (UniqueName: \"kubernetes.io/projected/903232b4-e460-47d2-8231-9bbc1837919f-kube-api-access-xjkjd\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.158538 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.158504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-metrics-certs\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.158724 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.158547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.158724 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.158564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903232b4-e460-47d2-8231-9bbc1837919f-openshift-service-ca\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.158724 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.158619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjkjd\" (UniqueName: \"kubernetes.io/projected/903232b4-e460-47d2-8231-9bbc1837919f-kube-api-access-xjkjd\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.158724 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:02:25.158667    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-serving-cert: secret "maas-api-e2e-ait-083e5ca1-serving-cert" not found
Sep 20 01:02:25.158979 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:02:25.158751    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls podName:903232b4-e460-47d2-8231-9bbc1837919f nodeName:}" failed. No retries permitted until 2026-09-20 01:02:25.658728816 +0000 UTC m=+901.908230601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls") pod "maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" (UID: "903232b4-e460-47d2-8231-9bbc1837919f") : secret "maas-api-e2e-ait-083e5ca1-serving-cert" not found
Sep 20 01:02:25.159330 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.159313    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903232b4-e460-47d2-8231-9bbc1837919f-openshift-service-ca\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.161083 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.161061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-metrics-certs\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.169086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.169066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjkjd\" (UniqueName: \"kubernetes.io/projected/903232b4-e460-47d2-8231-9bbc1837919f-kube-api-access-xjkjd\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.663704 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.663666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.666260 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.666235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls\") pod \"maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:25.929366 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:25.929336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:26.028518 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.028487    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:02:26.031274 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.031235    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:02:26.206696 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.206671    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"]
Sep 20 01:02:26.207606 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:02:26.207578    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903232b4_e460_47d2_8231_9bbc1837919f.slice/crio-98bf6a2d737d84664f39b7d471a1411069ebc44cb11bf824e391789044194c0d WatchSource:0}: Error finding container 98bf6a2d737d84664f39b7d471a1411069ebc44cb11bf824e391789044194c0d: Status 404 returned error can't find the container with id 98bf6a2d737d84664f39b7d471a1411069ebc44cb11bf824e391789044194c0d
Sep 20 01:02:26.769675 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.769638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" event={"ID":"903232b4-e460-47d2-8231-9bbc1837919f","Type":"ContainerStarted","Data":"22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc"}
Sep 20 01:02:26.769843 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.769696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" event={"ID":"903232b4-e460-47d2-8231-9bbc1837919f","Type":"ContainerStarted","Data":"98bf6a2d737d84664f39b7d471a1411069ebc44cb11bf824e391789044194c0d"}
Sep 20 01:02:26.769843 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.769723    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:26.786577 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:26.786530    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" podStartSLOduration=2.408450955 podStartE2EDuration="2.786514476s" totalImagesPullingTime="378.063521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:26.784893561 +0000 UTC m=+903.034395365" watchObservedRunningTime="2026-09-20 01:02:26.786514476 +0000 UTC m=+903.036016279"
Sep 20 01:02:32.781690 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:32.781658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:54.932219 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:54.932181    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"]
Sep 20 01:02:54.932772 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:54.932456    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" podUID="903232b4-e460-47d2-8231-9bbc1837919f" containerName="maas-api" containerID="cri-o://22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc" gracePeriod=30
Sep 20 01:02:55.199568 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.199500    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:55.248856 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.248823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjkjd\" (UniqueName: \"kubernetes.io/projected/903232b4-e460-47d2-8231-9bbc1837919f-kube-api-access-xjkjd\") pod \"903232b4-e460-47d2-8231-9bbc1837919f\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") "
Sep 20 01:02:55.249056 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.248872    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls\") pod \"903232b4-e460-47d2-8231-9bbc1837919f\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") "
Sep 20 01:02:55.249056 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.248957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-metrics-certs\") pod \"903232b4-e460-47d2-8231-9bbc1837919f\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") "
Sep 20 01:02:55.249056 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.249012    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903232b4-e460-47d2-8231-9bbc1837919f-openshift-service-ca\") pod \"903232b4-e460-47d2-8231-9bbc1837919f\" (UID: \"903232b4-e460-47d2-8231-9bbc1837919f\") "
Sep 20 01:02:55.249454 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.249427    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/903232b4-e460-47d2-8231-9bbc1837919f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "903232b4-e460-47d2-8231-9bbc1837919f" (UID: "903232b4-e460-47d2-8231-9bbc1837919f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:55.251114 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.251079    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "903232b4-e460-47d2-8231-9bbc1837919f" (UID: "903232b4-e460-47d2-8231-9bbc1837919f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:02:55.251235 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.251201    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903232b4-e460-47d2-8231-9bbc1837919f-kube-api-access-xjkjd" (OuterVolumeSpecName: "kube-api-access-xjkjd") pod "903232b4-e460-47d2-8231-9bbc1837919f" (UID: "903232b4-e460-47d2-8231-9bbc1837919f"). InnerVolumeSpecName "kube-api-access-xjkjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:55.251363 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.251258    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "903232b4-e460-47d2-8231-9bbc1837919f" (UID: "903232b4-e460-47d2-8231-9bbc1837919f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:02:55.349868 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.349831    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjkjd\" (UniqueName: \"kubernetes.io/projected/903232b4-e460-47d2-8231-9bbc1837919f-kube-api-access-xjkjd\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.349868 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.349869    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.350083 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.349883    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/903232b4-e460-47d2-8231-9bbc1837919f-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.350083 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.349895    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903232b4-e460-47d2-8231-9bbc1837919f-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.957553 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.957519    2568 generic.go:356] "Generic (PLEG): container finished" podID="903232b4-e460-47d2-8231-9bbc1837919f" containerID="22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc" exitCode=0
Sep 20 01:02:55.957946 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.957554    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" event={"ID":"903232b4-e460-47d2-8231-9bbc1837919f","Type":"ContainerDied","Data":"22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc"}
Sep 20 01:02:55.957946 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.957579    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"
Sep 20 01:02:55.957946 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.957640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs" event={"ID":"903232b4-e460-47d2-8231-9bbc1837919f","Type":"ContainerDied","Data":"98bf6a2d737d84664f39b7d471a1411069ebc44cb11bf824e391789044194c0d"}
Sep 20 01:02:55.957946 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.957664    2568 scope.go:117] "RemoveContainer" containerID="22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc"
Sep 20 01:02:55.968221 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.968203    2568 scope.go:117] "RemoveContainer" containerID="22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc"
Sep 20 01:02:55.968500 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:02:55.968480    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc\": container with ID starting with 22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc not found: ID does not exist" containerID="22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc"
Sep 20 01:02:55.968554 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.968508    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc"} err="failed to get container status \"22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc\": rpc error: code = NotFound desc = could not find container \"22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc\": container with ID starting with 22e615059bd6296f65587a324f4c201b90037f3cd6c5659d74d0bf602a0f22dc not found: ID does not exist"
Sep 20 01:02:55.979535 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.979514    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"]
Sep 20 01:02:55.989785 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:55.989765    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-083e5ca1-6c44b68869-v5trs"]
Sep 20 01:02:57.988048 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:02:57.988016    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903232b4-e460-47d2-8231-9bbc1837919f" path="/var/lib/kubelet/pods/903232b4-e460-47d2-8231-9bbc1837919f/volumes"
Sep 20 01:03:00.652410 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.652372    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"]
Sep 20 01:03:00.652898 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.652880    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903232b4-e460-47d2-8231-9bbc1837919f" containerName="maas-api"
Sep 20 01:03:00.652898 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.652899    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="903232b4-e460-47d2-8231-9bbc1837919f" containerName="maas-api"
Sep 20 01:03:00.653075 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.652997    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="903232b4-e460-47d2-8231-9bbc1837919f" containerName="maas-api"
Sep 20 01:03:00.657605 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.657584    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.659582 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.659546    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f689c4cd-serving-cert\""
Sep 20 01:03:00.670987 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.670966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"]
Sep 20 01:03:00.703306 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.703273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-metrics-certs\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.703473 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.703339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-openshift-service-ca\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.703473 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.703404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29c56\" (UniqueName: \"kubernetes.io/projected/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-kube-api-access-29c56\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.703473 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.703442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-maas-api-tls\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.804385 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.804344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c56\" (UniqueName: \"kubernetes.io/projected/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-kube-api-access-29c56\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.804385 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.804383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-maas-api-tls\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.804608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.804434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-metrics-certs\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.804608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.804472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-openshift-service-ca\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.805177 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.805152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-openshift-service-ca\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.806895 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.806875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-metrics-certs\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.807014 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.806901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-maas-api-tls\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.814032 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.814009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29c56\" (UniqueName: \"kubernetes.io/projected/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-kube-api-access-29c56\") pod \"maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:00.968825 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:00.968788    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:01.247311 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:01.247277    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"]
Sep 20 01:03:01.249351 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:03:01.249320    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa5fa6a_d511_4f2b_9698_ccc0a8e58cf0.slice/crio-871b7b9c2bd3f2abc4656022c8de8c1187024d4ee5d25dfd49d36404ac984844 WatchSource:0}: Error finding container 871b7b9c2bd3f2abc4656022c8de8c1187024d4ee5d25dfd49d36404ac984844: Status 404 returned error can't find the container with id 871b7b9c2bd3f2abc4656022c8de8c1187024d4ee5d25dfd49d36404ac984844
Sep 20 01:03:02.007106 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:02.007067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz" event={"ID":"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0","Type":"ContainerStarted","Data":"6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74"}
Sep 20 01:03:02.007531 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:02.007126    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz" event={"ID":"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0","Type":"ContainerStarted","Data":"871b7b9c2bd3f2abc4656022c8de8c1187024d4ee5d25dfd49d36404ac984844"}
Sep 20 01:03:02.007531 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:02.007159    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:02.025285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:02.025238    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz" podStartSLOduration=1.6554133530000001 podStartE2EDuration="2.025223288s" totalImagesPullingTime="369.809935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:02.024112402 +0000 UTC m=+938.273614205" watchObservedRunningTime="2026-09-20 01:03:02.025223288 +0000 UTC m=+938.274725126"
Sep 20 01:03:08.020089 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:08.020060    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:31.582550 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.582518    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"]
Sep 20 01:03:31.583076 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.582805    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz" podUID="8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" containerName="maas-api" containerID="cri-o://6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74" gracePeriod=30
Sep 20 01:03:31.837324 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.837261    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:31.998051 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.998022    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29c56\" (UniqueName: \"kubernetes.io/projected/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-kube-api-access-29c56\") pod \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") "
Sep 20 01:03:31.998245 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.998063    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-maas-api-tls\") pod \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") "
Sep 20 01:03:31.998245 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.998146    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-openshift-service-ca\") pod \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") "
Sep 20 01:03:31.998245 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.998165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-metrics-certs\") pod \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\" (UID: \"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0\") "
Sep 20 01:03:31.998515 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:31.998490    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" (UID: "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:32.000303 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.000269    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" (UID: "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:03:32.000428 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.000340    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" (UID: "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:03:32.000428 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.000365    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-kube-api-access-29c56" (OuterVolumeSpecName: "kube-api-access-29c56") pod "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" (UID: "8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0"). InnerVolumeSpecName "kube-api-access-29c56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:32.099860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.099777    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.099860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.099811    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.099860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.099823    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29c56\" (UniqueName: \"kubernetes.io/projected/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-kube-api-access-29c56\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.099860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.099831    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.211109 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.211075    2568 generic.go:356] "Generic (PLEG): container finished" podID="8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" containerID="6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74" exitCode=0
Sep 20 01:03:32.211289 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.211125    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"
Sep 20 01:03:32.211289 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.211174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz" event={"ID":"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0","Type":"ContainerDied","Data":"6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74"}
Sep 20 01:03:32.211289 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.211236    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz" event={"ID":"8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0","Type":"ContainerDied","Data":"871b7b9c2bd3f2abc4656022c8de8c1187024d4ee5d25dfd49d36404ac984844"}
Sep 20 01:03:32.211289 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.211266    2568 scope.go:117] "RemoveContainer" containerID="6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74"
Sep 20 01:03:32.221670 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.221648    2568 scope.go:117] "RemoveContainer" containerID="6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74"
Sep 20 01:03:32.222059 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:03:32.222040    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74\": container with ID starting with 6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74 not found: ID does not exist" containerID="6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74"
Sep 20 01:03:32.222138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.222071    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74"} err="failed to get container status \"6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74\": rpc error: code = NotFound desc = could not find container \"6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74\": container with ID starting with 6442f58547ab0213a3224f1af754366e08dcfed42c11f00eaf0eb77e0778ca74 not found: ID does not exist"
Sep 20 01:03:32.233956 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.233905    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"]
Sep 20 01:03:32.238789 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:32.238766    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f689c4cd-7b8856486c-x9qxz"]
Sep 20 01:03:33.991086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:33.989247    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" path="/var/lib/kubelet/pods/8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0/volumes"
Sep 20 01:03:52.681279 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.681201    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"]
Sep 20 01:03:52.681814 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.681444    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9" podUID="8f59f105-ad4d-4f38-81da-1417077da125" containerName="maas-api" containerID="cri-o://92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32" gracePeriod=30
Sep 20 01:03:52.951110 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.951078    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:03:52.995959 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.995908    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mptxk\" (UniqueName: \"kubernetes.io/projected/8f59f105-ad4d-4f38-81da-1417077da125-kube-api-access-mptxk\") pod \"8f59f105-ad4d-4f38-81da-1417077da125\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") "
Sep 20 01:03:52.996190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.995989    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-metrics-certs\") pod \"8f59f105-ad4d-4f38-81da-1417077da125\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") "
Sep 20 01:03:52.996190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.996042    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-maas-api-tls\") pod \"8f59f105-ad4d-4f38-81da-1417077da125\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") "
Sep 20 01:03:52.996190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.996105    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f59f105-ad4d-4f38-81da-1417077da125-openshift-service-ca\") pod \"8f59f105-ad4d-4f38-81da-1417077da125\" (UID: \"8f59f105-ad4d-4f38-81da-1417077da125\") "
Sep 20 01:03:52.996510 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.996481    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f59f105-ad4d-4f38-81da-1417077da125-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f59f105-ad4d-4f38-81da-1417077da125" (UID: "8f59f105-ad4d-4f38-81da-1417077da125"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:52.998244 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.998217    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f59f105-ad4d-4f38-81da-1417077da125" (UID: "8f59f105-ad4d-4f38-81da-1417077da125"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:03:52.998600 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.998571    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f59f105-ad4d-4f38-81da-1417077da125-kube-api-access-mptxk" (OuterVolumeSpecName: "kube-api-access-mptxk") pod "8f59f105-ad4d-4f38-81da-1417077da125" (UID: "8f59f105-ad4d-4f38-81da-1417077da125"). InnerVolumeSpecName "kube-api-access-mptxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:52.998600 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:52.998571    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8f59f105-ad4d-4f38-81da-1417077da125" (UID: "8f59f105-ad4d-4f38-81da-1417077da125"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:03:53.097297 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.097254    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mptxk\" (UniqueName: \"kubernetes.io/projected/8f59f105-ad4d-4f38-81da-1417077da125-kube-api-access-mptxk\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.097297 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.097290    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.097297 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.097306    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f59f105-ad4d-4f38-81da-1417077da125-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.097297 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.097317    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f59f105-ad4d-4f38-81da-1417077da125-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.339555 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.339470    2568 generic.go:356] "Generic (PLEG): container finished" podID="8f59f105-ad4d-4f38-81da-1417077da125" containerID="92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32" exitCode=0
Sep 20 01:03:53.339555 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.339530    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"
Sep 20 01:03:53.339555 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.339549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9" event={"ID":"8f59f105-ad4d-4f38-81da-1417077da125","Type":"ContainerDied","Data":"92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32"}
Sep 20 01:03:53.339800 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.339624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9" event={"ID":"8f59f105-ad4d-4f38-81da-1417077da125","Type":"ContainerDied","Data":"5103a7750133032d0dc54a0f3f4d404d8533c5fc9410b7ccb9601febf20bcee3"}
Sep 20 01:03:53.339800 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.339648    2568 scope.go:117] "RemoveContainer" containerID="92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32"
Sep 20 01:03:53.350979 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.350957    2568 scope.go:117] "RemoveContainer" containerID="92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32"
Sep 20 01:03:53.351242 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:03:53.351221    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32\": container with ID starting with 92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32 not found: ID does not exist" containerID="92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32"
Sep 20 01:03:53.351319 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.351250    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32"} err="failed to get container status \"92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32\": rpc error: code = NotFound desc = could not find container \"92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32\": container with ID starting with 92a58149ac69ac4fc258d6271a76fbf94f732dc26443677cc83a5f26009adb32 not found: ID does not exist"
Sep 20 01:03:53.362474 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.362451    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"]
Sep 20 01:03:53.365653 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.365628    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-173fde-86c6d4fb8-blrt9"]
Sep 20 01:03:53.987889 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:03:53.987837    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f59f105-ad4d-4f38-81da-1417077da125" path="/var/lib/kubelet/pods/8f59f105-ad4d-4f38-81da-1417077da125/volumes"
Sep 20 01:04:11.847453 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.847417    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"]
Sep 20 01:04:11.847973 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.847946    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f59f105-ad4d-4f38-81da-1417077da125" containerName="maas-api"
Sep 20 01:04:11.847973 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.847960    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f59f105-ad4d-4f38-81da-1417077da125" containerName="maas-api"
Sep 20 01:04:11.848055 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.847994    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" containerName="maas-api"
Sep 20 01:04:11.848055 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.848001    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" containerName="maas-api"
Sep 20 01:04:11.848118 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.848072    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f59f105-ad4d-4f38-81da-1417077da125" containerName="maas-api"
Sep 20 01:04:11.848118 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.848083    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa5fa6a-d511-4f2b-9698-ccc0a8e58cf0" containerName="maas-api"
Sep 20 01:04:11.852806 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.852777    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:11.855060 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.855036    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-7db579-serving-cert\""
Sep 20 01:04:11.860706 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.860681    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"]
Sep 20 01:04:11.966357 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.966316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae170f9c-10f8-497c-ae41-7b150db003a6-openshift-service-ca\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:11.966552 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.966383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfhb6\" (UniqueName: \"kubernetes.io/projected/ae170f9c-10f8-497c-ae41-7b150db003a6-kube-api-access-kfhb6\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:11.966552 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.966440    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-metrics-certs\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:11.966552 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:11.966530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-maas-api-tls\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.067615 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.067578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-metrics-certs\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.067800 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.067697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-maas-api-tls\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.067972 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.067950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae170f9c-10f8-497c-ae41-7b150db003a6-openshift-service-ca\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.068082 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.068040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfhb6\" (UniqueName: \"kubernetes.io/projected/ae170f9c-10f8-497c-ae41-7b150db003a6-kube-api-access-kfhb6\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.068826 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.068800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae170f9c-10f8-497c-ae41-7b150db003a6-openshift-service-ca\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.070263 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.070231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-metrics-certs\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.070386 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.070267    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-maas-api-tls\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.075600 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.075572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfhb6\" (UniqueName: \"kubernetes.io/projected/ae170f9c-10f8-497c-ae41-7b150db003a6-kube-api-access-kfhb6\") pod \"maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.165775 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.165693    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:12.442832 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.442803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"]
Sep 20 01:04:12.445283 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:04:12.445242    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae170f9c_10f8_497c_ae41_7b150db003a6.slice/crio-a000fa0e5614d8ba33dcdc4901dc73527f237cce2dcf4e06122737d711458f21 WatchSource:0}: Error finding container a000fa0e5614d8ba33dcdc4901dc73527f237cce2dcf4e06122737d711458f21: Status 404 returned error can't find the container with id a000fa0e5614d8ba33dcdc4901dc73527f237cce2dcf4e06122737d711458f21
Sep 20 01:04:12.446623 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.446603    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:04:12.455965 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:12.455942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm" event={"ID":"ae170f9c-10f8-497c-ae41-7b150db003a6","Type":"ContainerStarted","Data":"a000fa0e5614d8ba33dcdc4901dc73527f237cce2dcf4e06122737d711458f21"}
Sep 20 01:04:13.463186 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:13.463151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm" event={"ID":"ae170f9c-10f8-497c-ae41-7b150db003a6","Type":"ContainerStarted","Data":"bfecf7d3d52f43deff33b7284929101d80c6c4cf50d016e4b8332141fa5461d5"}
Sep 20 01:04:13.463629 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:13.463235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:13.479490 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:13.479446    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm" podStartSLOduration=2.100539365 podStartE2EDuration="2.479432197s" totalImagesPullingTime="378.892832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:13.478457944 +0000 UTC m=+1009.727959760" watchObservedRunningTime="2026-09-20 01:04:13.479432197 +0000 UTC m=+1009.728934001"
Sep 20 01:04:19.481869 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:19.481839    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:04:32.386051 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.386014    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"]
Sep 20 01:04:32.391001 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.390981    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.393835 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.393807    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"openshift-service-ca.crt\""
Sep 20 01:04:32.393973 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.393840    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"premium-w4-4e301e-kserve-self-signed-certs\""
Sep 20 01:04:32.393973 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.393852    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"default-dockercfg-xmm6m\""
Sep 20 01:04:32.394156 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.394136    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"kube-root-ca.crt\""
Sep 20 01:04:32.398203 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.398166    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"]
Sep 20 01:04:32.450264 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.450234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-home\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.450430 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.450269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-model-cache\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.450430 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.450319    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrsnv\" (UniqueName: \"kubernetes.io/projected/629910ed-550d-43f1-abf8-bcd8add6afa6-kube-api-access-qrsnv\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.450430 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.450342    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629910ed-550d-43f1-abf8-bcd8add6afa6-tls-certs\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.450430 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.450355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-dshm\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.450573 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.450487    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-tmp-dir\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.551698 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.551665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsnv\" (UniqueName: \"kubernetes.io/projected/629910ed-550d-43f1-abf8-bcd8add6afa6-kube-api-access-qrsnv\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.551901 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.551706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629910ed-550d-43f1-abf8-bcd8add6afa6-tls-certs\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.551901 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.551726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-dshm\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.551901 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.551759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-tmp-dir\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.551901 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.551818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-home\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.552171 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.551980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-model-cache\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.552276 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.552250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-home\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.552318 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.552272    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-tmp-dir\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.552365 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.552339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-model-cache\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.554054 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.554033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-dshm\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.554479 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.554456    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629910ed-550d-43f1-abf8-bcd8add6afa6-tls-certs\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.559037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.559009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrsnv\" (UniqueName: \"kubernetes.io/projected/629910ed-550d-43f1-abf8-bcd8add6afa6-kube-api-access-qrsnv\") pod \"premium-w4-4e301e-kserve-69b57b5cdb-755qz\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") " pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.700867 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.700834    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:32.978649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:32.978619    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"]
Sep 20 01:04:32.980054 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:04:32.980027    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod629910ed_550d_43f1_abf8_bcd8add6afa6.slice/crio-3be1cd4f00eda1dc103d5fb4f6afe2b6ef2a02997859b8a6c8b8b6880f918b02 WatchSource:0}: Error finding container 3be1cd4f00eda1dc103d5fb4f6afe2b6ef2a02997859b8a6c8b8b6880f918b02: Status 404 returned error can't find the container with id 3be1cd4f00eda1dc103d5fb4f6afe2b6ef2a02997859b8a6c8b8b6880f918b02
Sep 20 01:04:33.583025 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:33.582988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz" event={"ID":"629910ed-550d-43f1-abf8-bcd8add6afa6","Type":"ContainerStarted","Data":"fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0"}
Sep 20 01:04:33.583025 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:33.583030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz" event={"ID":"629910ed-550d-43f1-abf8-bcd8add6afa6","Type":"ContainerStarted","Data":"3be1cd4f00eda1dc103d5fb4f6afe2b6ef2a02997859b8a6c8b8b6880f918b02"}
Sep 20 01:04:33.599093 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:33.599043    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz" podStartSLOduration=1.599028586 podStartE2EDuration="1.599028586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:33.596489098 +0000 UTC m=+1029.845990903" watchObservedRunningTime="2026-09-20 01:04:33.599028586 +0000 UTC m=+1029.848530390"
Sep 20 01:04:42.701814 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:42.701772    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:42.701814 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:42.701823    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:42.714975 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:42.714940    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:04:43.649846 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:04:43.649819    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:05:18.379186 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.379106    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"]
Sep 20 01:05:18.383239 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.383213    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.385158 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.385139    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0b0a5312-serving-cert\""
Sep 20 01:05:18.391218 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.391190    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"]
Sep 20 01:05:18.468285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.468238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgpfk\" (UniqueName: \"kubernetes.io/projected/8d1dc699-c009-4df8-a636-8684b6f81a69-kube-api-access-fgpfk\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.468464 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.468301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-metrics-certs\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.468464 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.468382    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.468464 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.468430    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dc699-c009-4df8-a636-8684b6f81a69-openshift-service-ca\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.569400 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.569370    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.569608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.569418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dc699-c009-4df8-a636-8684b6f81a69-openshift-service-ca\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.569608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.569445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgpfk\" (UniqueName: \"kubernetes.io/projected/8d1dc699-c009-4df8-a636-8684b6f81a69-kube-api-access-fgpfk\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.569608 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.569473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-metrics-certs\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.569608 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:05:18.569517    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-serving-cert: secret "maas-api-e2e-mt-0b0a5312-serving-cert" not found
Sep 20 01:05:18.569608 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:05:18.569574    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls podName:8d1dc699-c009-4df8-a636-8684b6f81a69 nodeName:}" failed. No retries permitted until 2026-09-20 01:05:19.069559541 +0000 UTC m=+1075.319061323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls") pod "maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" (UID: "8d1dc699-c009-4df8-a636-8684b6f81a69") : secret "maas-api-e2e-mt-0b0a5312-serving-cert" not found
Sep 20 01:05:18.570213 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.570195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dc699-c009-4df8-a636-8684b6f81a69-openshift-service-ca\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.572087 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.572064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-metrics-certs\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:18.579606 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:18.579585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgpfk\" (UniqueName: \"kubernetes.io/projected/8d1dc699-c009-4df8-a636-8684b6f81a69-kube-api-access-fgpfk\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:19.073229 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:19.073190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:19.075526 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:19.075500    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls\") pod \"maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:19.297642 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:19.297606    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:19.573465 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:19.573437    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"]
Sep 20 01:05:19.575047 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:05:19.575020    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1dc699_c009_4df8_a636_8684b6f81a69.slice/crio-78afbdfae971c017aea09d3db0096094f302b0d64b3a79b128479edfcf778c8a WatchSource:0}: Error finding container 78afbdfae971c017aea09d3db0096094f302b0d64b3a79b128479edfcf778c8a: Status 404 returned error can't find the container with id 78afbdfae971c017aea09d3db0096094f302b0d64b3a79b128479edfcf778c8a
Sep 20 01:05:19.850992 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:19.850954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" event={"ID":"8d1dc699-c009-4df8-a636-8684b6f81a69","Type":"ContainerStarted","Data":"78afbdfae971c017aea09d3db0096094f302b0d64b3a79b128479edfcf778c8a"}
Sep 20 01:05:20.858617 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:20.858582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" event={"ID":"8d1dc699-c009-4df8-a636-8684b6f81a69","Type":"ContainerStarted","Data":"3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3"}
Sep 20 01:05:20.859022 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:20.858691    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:20.877551 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:20.877498    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" podStartSLOduration=2.419779861 podStartE2EDuration="2.877483692s" totalImagesPullingTime="457.703831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:20.874910455 +0000 UTC m=+1077.124412259" watchObservedRunningTime="2026-09-20 01:05:20.877483692 +0000 UTC m=+1077.126985496"
Sep 20 01:05:26.870852 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:26.870820    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:05:46.825398 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:46.825359    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"]
Sep 20 01:05:46.825861 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:46.825616    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm" podUID="ae170f9c-10f8-497c-ae41-7b150db003a6" containerName="maas-api" containerID="cri-o://bfecf7d3d52f43deff33b7284929101d80c6c4cf50d016e4b8332141fa5461d5" gracePeriod=30
Sep 20 01:05:47.016956 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.016907    2568 generic.go:356] "Generic (PLEG): container finished" podID="ae170f9c-10f8-497c-ae41-7b150db003a6" containerID="bfecf7d3d52f43deff33b7284929101d80c6c4cf50d016e4b8332141fa5461d5" exitCode=0
Sep 20 01:05:47.017140 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.016951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm" event={"ID":"ae170f9c-10f8-497c-ae41-7b150db003a6","Type":"ContainerDied","Data":"bfecf7d3d52f43deff33b7284929101d80c6c4cf50d016e4b8332141fa5461d5"}
Sep 20 01:05:47.102812 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.102785    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:05:47.229111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.229080    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae170f9c-10f8-497c-ae41-7b150db003a6-openshift-service-ca\") pod \"ae170f9c-10f8-497c-ae41-7b150db003a6\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") "
Sep 20 01:05:47.229305 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.229198    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-metrics-certs\") pod \"ae170f9c-10f8-497c-ae41-7b150db003a6\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") "
Sep 20 01:05:47.229305 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.229243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-maas-api-tls\") pod \"ae170f9c-10f8-497c-ae41-7b150db003a6\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") "
Sep 20 01:05:47.229305 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.229294    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfhb6\" (UniqueName: \"kubernetes.io/projected/ae170f9c-10f8-497c-ae41-7b150db003a6-kube-api-access-kfhb6\") pod \"ae170f9c-10f8-497c-ae41-7b150db003a6\" (UID: \"ae170f9c-10f8-497c-ae41-7b150db003a6\") "
Sep 20 01:05:47.229490 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.229450    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae170f9c-10f8-497c-ae41-7b150db003a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae170f9c-10f8-497c-ae41-7b150db003a6" (UID: "ae170f9c-10f8-497c-ae41-7b150db003a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:05:47.229663 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.229639    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae170f9c-10f8-497c-ae41-7b150db003a6-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:05:47.231550 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.231524    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae170f9c-10f8-497c-ae41-7b150db003a6-kube-api-access-kfhb6" (OuterVolumeSpecName: "kube-api-access-kfhb6") pod "ae170f9c-10f8-497c-ae41-7b150db003a6" (UID: "ae170f9c-10f8-497c-ae41-7b150db003a6"). InnerVolumeSpecName "kube-api-access-kfhb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:05:47.231795 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.231769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae170f9c-10f8-497c-ae41-7b150db003a6" (UID: "ae170f9c-10f8-497c-ae41-7b150db003a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:05:47.231877 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.231797    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae170f9c-10f8-497c-ae41-7b150db003a6" (UID: "ae170f9c-10f8-497c-ae41-7b150db003a6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:05:47.331175 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.331089    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:05:47.331175 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.331119    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfhb6\" (UniqueName: \"kubernetes.io/projected/ae170f9c-10f8-497c-ae41-7b150db003a6-kube-api-access-kfhb6\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:05:47.331175 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:47.331130    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae170f9c-10f8-497c-ae41-7b150db003a6-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:05:48.024190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:48.024160    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"
Sep 20 01:05:48.024574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:48.024198    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm" event={"ID":"ae170f9c-10f8-497c-ae41-7b150db003a6","Type":"ContainerDied","Data":"a000fa0e5614d8ba33dcdc4901dc73527f237cce2dcf4e06122737d711458f21"}
Sep 20 01:05:48.024574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:48.024256    2568 scope.go:117] "RemoveContainer" containerID="bfecf7d3d52f43deff33b7284929101d80c6c4cf50d016e4b8332141fa5461d5"
Sep 20 01:05:48.041028 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:48.041004    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"]
Sep 20 01:05:48.048570 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:48.048541    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7db579-66bd5d74cf-cbgpm"]
Sep 20 01:05:49.988157 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:05:49.988122    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae170f9c-10f8-497c-ae41-7b150db003a6" path="/var/lib/kubelet/pods/ae170f9c-10f8-497c-ae41-7b150db003a6/volumes"
Sep 20 01:06:02.790570 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:02.790531    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"]
Sep 20 01:06:02.791114 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:02.790830    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" podUID="8d1dc699-c009-4df8-a636-8684b6f81a69" containerName="maas-api" containerID="cri-o://3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3" gracePeriod=30
Sep 20 01:06:03.061794 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.061762    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:06:03.128927 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.128877    2568 generic.go:356] "Generic (PLEG): container finished" podID="8d1dc699-c009-4df8-a636-8684b6f81a69" containerID="3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3" exitCode=0
Sep 20 01:06:03.129103 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.128955    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"
Sep 20 01:06:03.129103 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.128972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" event={"ID":"8d1dc699-c009-4df8-a636-8684b6f81a69","Type":"ContainerDied","Data":"3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3"}
Sep 20 01:06:03.129103 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.129031    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8" event={"ID":"8d1dc699-c009-4df8-a636-8684b6f81a69","Type":"ContainerDied","Data":"78afbdfae971c017aea09d3db0096094f302b0d64b3a79b128479edfcf778c8a"}
Sep 20 01:06:03.129103 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.129053    2568 scope.go:117] "RemoveContainer" containerID="3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3"
Sep 20 01:06:03.138107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.138077    2568 scope.go:117] "RemoveContainer" containerID="3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3"
Sep 20 01:06:03.138470 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:06:03.138442    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3\": container with ID starting with 3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3 not found: ID does not exist" containerID="3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3"
Sep 20 01:06:03.138561 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.138483    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3"} err="failed to get container status \"3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3\": rpc error: code = NotFound desc = could not find container \"3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3\": container with ID starting with 3c5648578cf34a7f6a11028f34055e73099d099968da4dc65c2f0c293b6a76e3 not found: ID does not exist"
Sep 20 01:06:03.190762 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.190731    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dc699-c009-4df8-a636-8684b6f81a69-openshift-service-ca\") pod \"8d1dc699-c009-4df8-a636-8684b6f81a69\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") "
Sep 20 01:06:03.190967 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.190783    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgpfk\" (UniqueName: \"kubernetes.io/projected/8d1dc699-c009-4df8-a636-8684b6f81a69-kube-api-access-fgpfk\") pod \"8d1dc699-c009-4df8-a636-8684b6f81a69\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") "
Sep 20 01:06:03.190967 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.190861    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-metrics-certs\") pod \"8d1dc699-c009-4df8-a636-8684b6f81a69\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") "
Sep 20 01:06:03.190967 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.190891    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls\") pod \"8d1dc699-c009-4df8-a636-8684b6f81a69\" (UID: \"8d1dc699-c009-4df8-a636-8684b6f81a69\") "
Sep 20 01:06:03.191187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.191163    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1dc699-c009-4df8-a636-8684b6f81a69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d1dc699-c009-4df8-a636-8684b6f81a69" (UID: "8d1dc699-c009-4df8-a636-8684b6f81a69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:06:03.191252 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.191226    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1dc699-c009-4df8-a636-8684b6f81a69-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.193187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.193154    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1dc699-c009-4df8-a636-8684b6f81a69-kube-api-access-fgpfk" (OuterVolumeSpecName: "kube-api-access-fgpfk") pod "8d1dc699-c009-4df8-a636-8684b6f81a69" (UID: "8d1dc699-c009-4df8-a636-8684b6f81a69"). InnerVolumeSpecName "kube-api-access-fgpfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:06:03.193364 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.193259    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8d1dc699-c009-4df8-a636-8684b6f81a69" (UID: "8d1dc699-c009-4df8-a636-8684b6f81a69"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:06:03.193364 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.193282    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d1dc699-c009-4df8-a636-8684b6f81a69" (UID: "8d1dc699-c009-4df8-a636-8684b6f81a69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:06:03.292212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.292122    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.292212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.292151    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgpfk\" (UniqueName: \"kubernetes.io/projected/8d1dc699-c009-4df8-a636-8684b6f81a69-kube-api-access-fgpfk\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.292212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.292161    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d1dc699-c009-4df8-a636-8684b6f81a69-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.455724 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.455692    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"]
Sep 20 01:06:03.458197 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.458176    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0b0a5312-f774896f8-2j4s8"]
Sep 20 01:06:03.987510 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:03.987479    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1dc699-c009-4df8-a636-8684b6f81a69" path="/var/lib/kubelet/pods/8d1dc699-c009-4df8-a636-8684b6f81a69/volumes"
Sep 20 01:06:29.302226 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302184    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"]
Sep 20 01:06:29.302853 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302834    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae170f9c-10f8-497c-ae41-7b150db003a6" containerName="maas-api"
Sep 20 01:06:29.302853 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302854    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae170f9c-10f8-497c-ae41-7b150db003a6" containerName="maas-api"
Sep 20 01:06:29.302983 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302865    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1dc699-c009-4df8-a636-8684b6f81a69" containerName="maas-api"
Sep 20 01:06:29.302983 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302871    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1dc699-c009-4df8-a636-8684b6f81a69" containerName="maas-api"
Sep 20 01:06:29.302983 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302959    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae170f9c-10f8-497c-ae41-7b150db003a6" containerName="maas-api"
Sep 20 01:06:29.302983 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.302968    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d1dc699-c009-4df8-a636-8684b6f81a69" containerName="maas-api"
Sep 20 01:06:29.307451 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.307433    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.309333 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.309301    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-0766ea-serving-cert\""
Sep 20 01:06:29.315616 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.315583    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"]
Sep 20 01:06:29.422541 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.422508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ec0dda-95ec-4577-9b7e-4162158fd8c7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.422722 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.422555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7wb\" (UniqueName: \"kubernetes.io/projected/11ec0dda-95ec-4577-9b7e-4162158fd8c7-kube-api-access-zd7wb\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.422722 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.422616    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.422722 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.422698    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.523307 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.523274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7wb\" (UniqueName: \"kubernetes.io/projected/11ec0dda-95ec-4577-9b7e-4162158fd8c7-kube-api-access-zd7wb\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.523481 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.523335    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.523481 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.523375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.523481 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.523405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ec0dda-95ec-4577-9b7e-4162158fd8c7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.524041 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.524017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ec0dda-95ec-4577-9b7e-4162158fd8c7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.525812 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.525791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.525937 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.525842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.531288 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.531269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7wb\" (UniqueName: \"kubernetes.io/projected/11ec0dda-95ec-4577-9b7e-4162158fd8c7-kube-api-access-zd7wb\") pod \"maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.621022 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.620907    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:29.899314 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:29.899284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"]
Sep 20 01:06:29.901166 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:06:29.901134    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ec0dda_95ec_4577_9b7e_4162158fd8c7.slice/crio-4a222055ee60599d052c29c8fc10a86819e7d2d9ffc8151e13b212c493708dda WatchSource:0}: Error finding container 4a222055ee60599d052c29c8fc10a86819e7d2d9ffc8151e13b212c493708dda: Status 404 returned error can't find the container with id 4a222055ee60599d052c29c8fc10a86819e7d2d9ffc8151e13b212c493708dda
Sep 20 01:06:30.297839 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:30.297801    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2" event={"ID":"11ec0dda-95ec-4577-9b7e-4162158fd8c7","Type":"ContainerStarted","Data":"f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378"}
Sep 20 01:06:30.298030 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:30.297864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2" event={"ID":"11ec0dda-95ec-4577-9b7e-4162158fd8c7","Type":"ContainerStarted","Data":"4a222055ee60599d052c29c8fc10a86819e7d2d9ffc8151e13b212c493708dda"}
Sep 20 01:06:30.298030 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:30.297965    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:30.314683 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:30.314635    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2" podStartSLOduration=0.995815063 podStartE2EDuration="1.314619842s" totalImagesPullingTime="318.804779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:06:30.312377871 +0000 UTC m=+1146.561879677" watchObservedRunningTime="2026-09-20 01:06:30.314619842 +0000 UTC m=+1146.564121646"
Sep 20 01:06:36.310071 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:36.310042    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:06:50.090523 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.090384    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"]
Sep 20 01:06:50.094142 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.094122    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.096157 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.096135    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"openshift-service-ca.crt\""
Sep 20 01:06:50.096994 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.096972    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"kube-root-ca.crt\""
Sep 20 01:06:50.097097 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.096999    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"default-dockercfg-f5qb4\""
Sep 20 01:06:50.097097 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.096972    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"distinct-w0-e2e8bc-kserve-self-signed-certs\""
Sep 20 01:06:50.103880 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.103860    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"]
Sep 20 01:06:50.222471 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.222437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-model-cache\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.222634 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.222476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5fp\" (UniqueName: \"kubernetes.io/projected/3586680a-59b3-45c1-bef6-2951237adefa-kube-api-access-tw5fp\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.222634 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.222519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3586680a-59b3-45c1-bef6-2951237adefa-tls-certs\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.222634 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.222567    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-dshm\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.222634 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.222585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-tmp-dir\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.222773 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.222643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-home\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.323482 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.323448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-dshm\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.323482 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.323482    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-tmp-dir\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.323695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.323511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-home\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.323695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.323577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-model-cache\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.323695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.323601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5fp\" (UniqueName: \"kubernetes.io/projected/3586680a-59b3-45c1-bef6-2951237adefa-kube-api-access-tw5fp\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.323695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.323629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3586680a-59b3-45c1-bef6-2951237adefa-tls-certs\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.324037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.324010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-tmp-dir\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.324160 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.324015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-home\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.324160 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.324065    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-model-cache\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.325782 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.325760    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-dshm\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.326265 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.326245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3586680a-59b3-45c1-bef6-2951237adefa-tls-certs\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.330741 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.330717    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5fp\" (UniqueName: \"kubernetes.io/projected/3586680a-59b3-45c1-bef6-2951237adefa-kube-api-access-tw5fp\") pod \"distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.405291 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.405210    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:06:50.685015 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:50.684987    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"]
Sep 20 01:06:50.686692 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:06:50.686668    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3586680a_59b3_45c1_bef6_2951237adefa.slice/crio-9374163ed287fad38b18cb1ca4900c4918b7dd2f7979504d133136ec694b2a46 WatchSource:0}: Error finding container 9374163ed287fad38b18cb1ca4900c4918b7dd2f7979504d133136ec694b2a46: Status 404 returned error can't find the container with id 9374163ed287fad38b18cb1ca4900c4918b7dd2f7979504d133136ec694b2a46
Sep 20 01:06:51.421454 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:51.421417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd" event={"ID":"3586680a-59b3-45c1-bef6-2951237adefa","Type":"ContainerStarted","Data":"c0a1e910f48124911586a1df2ddbc48c2740f5c613fdd96fff16995a54e27332"}
Sep 20 01:06:51.421904 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:51.421463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd" event={"ID":"3586680a-59b3-45c1-bef6-2951237adefa","Type":"ContainerStarted","Data":"9374163ed287fad38b18cb1ca4900c4918b7dd2f7979504d133136ec694b2a46"}
Sep 20 01:06:51.437880 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:06:51.437831    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd" podStartSLOduration=1.437817356 podStartE2EDuration="1.437817356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:06:51.435058359 +0000 UTC m=+1167.684560155" watchObservedRunningTime="2026-09-20 01:06:51.437817356 +0000 UTC m=+1167.687319160"
Sep 20 01:07:00.406190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:00.406143    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:07:00.406190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:00.406199    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:07:00.419455 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:00.419432    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:07:00.496376 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:00.496347    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:07:04.507369 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.507329    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"]
Sep 20 01:07:04.512836 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.512815    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.514645 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.514615    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-b8cbf1-serving-cert\""
Sep 20 01:07:04.521096 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.521071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"]
Sep 20 01:07:04.564401 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.564364    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac985075-e30d-4aa1-88af-d68939bcaf19-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.564568 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.564418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.564568 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.564519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.564662 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.564560    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c68fm\" (UniqueName: \"kubernetes.io/projected/ac985075-e30d-4aa1-88af-d68939bcaf19-kube-api-access-c68fm\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.665391 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.665355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac985075-e30d-4aa1-88af-d68939bcaf19-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.665557 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.665420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.665557 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.665475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.665557 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.665503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c68fm\" (UniqueName: \"kubernetes.io/projected/ac985075-e30d-4aa1-88af-d68939bcaf19-kube-api-access-c68fm\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.665699 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:04.665579    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-serving-cert: secret "maas-api-e2e-shared-b-w2-b8cbf1-serving-cert" not found
Sep 20 01:07:04.665699 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:04.665662    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls podName:ac985075-e30d-4aa1-88af-d68939bcaf19 nodeName:}" failed. No retries permitted until 2026-09-20 01:07:05.165643702 +0000 UTC m=+1181.415145486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls") pod "maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" (UID: "ac985075-e30d-4aa1-88af-d68939bcaf19") : secret "maas-api-e2e-shared-b-w2-b8cbf1-serving-cert" not found
Sep 20 01:07:04.666166 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.666144    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac985075-e30d-4aa1-88af-d68939bcaf19-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.667926 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.667899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:04.673138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:04.673120    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c68fm\" (UniqueName: \"kubernetes.io/projected/ac985075-e30d-4aa1-88af-d68939bcaf19-kube-api-access-c68fm\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:05.170248 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:05.170210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:05.172851 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:05.172823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:05.426299 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:05.426203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:05.711729 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:05.711693    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"]
Sep 20 01:07:05.713138 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:07:05.713109    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac985075_e30d_4aa1_88af_d68939bcaf19.slice/crio-eb7ee8bc8af6f86370eb787a686c94bad39e09825134e4d49b3a1cb0a9bcd850 WatchSource:0}: Error finding container eb7ee8bc8af6f86370eb787a686c94bad39e09825134e4d49b3a1cb0a9bcd850: Status 404 returned error can't find the container with id eb7ee8bc8af6f86370eb787a686c94bad39e09825134e4d49b3a1cb0a9bcd850
Sep 20 01:07:06.524570 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:06.524533    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" event={"ID":"ac985075-e30d-4aa1-88af-d68939bcaf19","Type":"ContainerStarted","Data":"26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8"}
Sep 20 01:07:06.524570 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:06.524589    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" event={"ID":"ac985075-e30d-4aa1-88af-d68939bcaf19","Type":"ContainerStarted","Data":"eb7ee8bc8af6f86370eb787a686c94bad39e09825134e4d49b3a1cb0a9bcd850"}
Sep 20 01:07:06.524846 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:06.524612    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:06.540575 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:06.540529    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" podStartSLOduration=2.227397771 podStartE2EDuration="2.540514519s" totalImagesPullingTime="313.116748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:06.538852368 +0000 UTC m=+1182.788354167" watchObservedRunningTime="2026-09-20 01:07:06.540514519 +0000 UTC m=+1182.790016323"
Sep 20 01:07:12.539945 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:12.539896    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:07:26.079169 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:26.079143    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:07:26.084142 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:26.084114    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:07:31.281491 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.281456    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7605-772357"]
Sep 20 01:07:31.285364 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.285340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:31.287676 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.287655    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6z9kv\""
Sep 20 01:07:31.289113 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.289089    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-772357"]
Sep 20 01:07:31.427766 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.427728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vsh9\" (UniqueName: \"kubernetes.io/projected/452ca7e3-c07d-49ca-83e9-0ffb27e333d5-kube-api-access-9vsh9\") pod \"test-curl-7605-772357\" (UID: \"452ca7e3-c07d-49ca-83e9-0ffb27e333d5\") " pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:31.528643 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.528604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vsh9\" (UniqueName: \"kubernetes.io/projected/452ca7e3-c07d-49ca-83e9-0ffb27e333d5-kube-api-access-9vsh9\") pod \"test-curl-7605-772357\" (UID: \"452ca7e3-c07d-49ca-83e9-0ffb27e333d5\") " pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:31.536564 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.536504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vsh9\" (UniqueName: \"kubernetes.io/projected/452ca7e3-c07d-49ca-83e9-0ffb27e333d5-kube-api-access-9vsh9\") pod \"test-curl-7605-772357\" (UID: \"452ca7e3-c07d-49ca-83e9-0ffb27e333d5\") " pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:31.596202 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.596172    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:31.878564 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:31.878537    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-772357"]
Sep 20 01:07:31.880256 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:07:31.880216    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod452ca7e3_c07d_49ca_83e9_0ffb27e333d5.slice/crio-d6ca65012499639a60c6d2bd6c702e47e16c1e1ddd1e759d8fe4bdc813dcaecb WatchSource:0}: Error finding container d6ca65012499639a60c6d2bd6c702e47e16c1e1ddd1e759d8fe4bdc813dcaecb: Status 404 returned error can't find the container with id d6ca65012499639a60c6d2bd6c702e47e16c1e1ddd1e759d8fe4bdc813dcaecb
Sep 20 01:07:32.702867 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:32.702820    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-772357" event={"ID":"452ca7e3-c07d-49ca-83e9-0ffb27e333d5","Type":"ContainerStarted","Data":"eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb"}
Sep 20 01:07:32.703285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:32.702877    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-772357" event={"ID":"452ca7e3-c07d-49ca-83e9-0ffb27e333d5","Type":"ContainerStarted","Data":"d6ca65012499639a60c6d2bd6c702e47e16c1e1ddd1e759d8fe4bdc813dcaecb"}
Sep 20 01:07:32.718092 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:32.718034    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7605-772357" podStartSLOduration=1.718018284 podStartE2EDuration="1.718018284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:32.715010378 +0000 UTC m=+1208.964512187" watchObservedRunningTime="2026-09-20 01:07:32.718018284 +0000 UTC m=+1208.967520088"
Sep 20 01:07:33.330699 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.330665    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7605-772357"]
Sep 20 01:07:33.334972 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.334943    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7605-772357"]
Sep 20 01:07:33.453865 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.453833    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7605-1c4650"]
Sep 20 01:07:33.454298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.454284    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" containerName="test-curl-7605-772357"
Sep 20 01:07:33.454345 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.454301    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" containerName="test-curl-7605-772357"
Sep 20 01:07:33.454400 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.454391    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" containerName="test-curl-7605-772357"
Sep 20 01:07:33.457606 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.457571    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:33.461035 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.461012    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-1c4650"]
Sep 20 01:07:33.550244 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.550212    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktjwf\" (UniqueName: \"kubernetes.io/projected/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b-kube-api-access-ktjwf\") pod \"test-curl-7605-1c4650\" (UID: \"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b\") " pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:33.651351 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.651321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktjwf\" (UniqueName: \"kubernetes.io/projected/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b-kube-api-access-ktjwf\") pod \"test-curl-7605-1c4650\" (UID: \"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b\") " pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:33.658674 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.658647    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktjwf\" (UniqueName: \"kubernetes.io/projected/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b-kube-api-access-ktjwf\") pod \"test-curl-7605-1c4650\" (UID: \"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b\") " pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:33.709552 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:33.709484    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7605-772357" container="test-curl-7605-772357"
Sep 20 01:07:33.769394 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:33.769342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:34.038842 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:34.038811    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-1c4650"]
Sep 20 01:07:34.039600 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:07:34.039565    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ed6a759_3f2c_4bf6_bdac_df2fb7dc448b.slice/crio-717b0902f43ed7b9fcb7b41c53a5dbf04d19acd0884fd8e86d2918feccbb9626 WatchSource:0}: Error finding container 717b0902f43ed7b9fcb7b41c53a5dbf04d19acd0884fd8e86d2918feccbb9626: Status 404 returned error can't find the container with id 717b0902f43ed7b9fcb7b41c53a5dbf04d19acd0884fd8e86d2918feccbb9626
Sep 20 01:07:34.720044 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:34.720011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-1c4650" event={"ID":"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b","Type":"ContainerStarted","Data":"74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe"}
Sep 20 01:07:34.720044 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:34.720052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-1c4650" event={"ID":"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b","Type":"ContainerStarted","Data":"717b0902f43ed7b9fcb7b41c53a5dbf04d19acd0884fd8e86d2918feccbb9626"}
Sep 20 01:07:34.720573 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:34.720137    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7605-772357" podUID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" containerName="test-curl-7605-772357" containerID="cri-o://eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb" gracePeriod=2
Sep 20 01:07:34.734800 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:34.734759    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7605-1c4650" podStartSLOduration=1.734745022 podStartE2EDuration="1.734745022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:34.732362886 +0000 UTC m=+1210.981864691" watchObservedRunningTime="2026-09-20 01:07:34.734745022 +0000 UTC m=+1210.984246846"
Sep 20 01:07:35.325751 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.325715    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7605-1c4650"]
Sep 20 01:07:35.329711 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.329683    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7605-1c4650"]
Sep 20 01:07:35.437841 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.437813    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7605-28e0fb"]
Sep 20 01:07:35.438261 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.438248    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" containerName="test-curl-7605-1c4650"
Sep 20 01:07:35.438309 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.438263    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" containerName="test-curl-7605-1c4650"
Sep 20 01:07:35.438345 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.438332    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" containerName="test-curl-7605-1c4650"
Sep 20 01:07:35.442071 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.442018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:35.447116 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.447088    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-28e0fb"]
Sep 20 01:07:35.579435 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.579398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42b4n\" (UniqueName: \"kubernetes.io/projected/9bb817f1-3143-4cc2-8e47-e593291ed2c7-kube-api-access-42b4n\") pod \"test-curl-7605-28e0fb\" (UID: \"9bb817f1-3143-4cc2-8e47-e593291ed2c7\") " pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:35.680266 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.680223    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42b4n\" (UniqueName: \"kubernetes.io/projected/9bb817f1-3143-4cc2-8e47-e593291ed2c7-kube-api-access-42b4n\") pod \"test-curl-7605-28e0fb\" (UID: \"9bb817f1-3143-4cc2-8e47-e593291ed2c7\") " pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:35.687388 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.687362    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42b4n\" (UniqueName: \"kubernetes.io/projected/9bb817f1-3143-4cc2-8e47-e593291ed2c7-kube-api-access-42b4n\") pod \"test-curl-7605-28e0fb\" (UID: \"9bb817f1-3143-4cc2-8e47-e593291ed2c7\") " pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:35.725832 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:35.725756    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7605-1c4650" container="test-curl-7605-1c4650"
Sep 20 01:07:35.759626 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:35.759596    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:36.027876 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:36.027845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-28e0fb"]
Sep 20 01:07:36.029064 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:07:36.029039    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bb817f1_3143_4cc2_8e47_e593291ed2c7.slice/crio-dd3cff170bd9edf5b16cb14e4f140014b756c9017888eb55e759fdcc4edf6072 WatchSource:0}: Error finding container dd3cff170bd9edf5b16cb14e4f140014b756c9017888eb55e759fdcc4edf6072: Status 404 returned error can't find the container with id dd3cff170bd9edf5b16cb14e4f140014b756c9017888eb55e759fdcc4edf6072
Sep 20 01:07:36.733128 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:36.733097    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-28e0fb" event={"ID":"9bb817f1-3143-4cc2-8e47-e593291ed2c7","Type":"ContainerStarted","Data":"5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd"}
Sep 20 01:07:36.733431 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:36.733147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-28e0fb" event={"ID":"9bb817f1-3143-4cc2-8e47-e593291ed2c7","Type":"ContainerStarted","Data":"dd3cff170bd9edf5b16cb14e4f140014b756c9017888eb55e759fdcc4edf6072"}
Sep 20 01:07:36.733431 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:36.733262    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7605-1c4650" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" containerName="test-curl-7605-1c4650" containerID="cri-o://74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe" gracePeriod=2
Sep 20 01:07:36.747756 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:36.747712    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7605-28e0fb" podStartSLOduration=1.747695461 podStartE2EDuration="1.747695461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:36.745400594 +0000 UTC m=+1212.994902399" watchObservedRunningTime="2026-09-20 01:07:36.747695461 +0000 UTC m=+1212.997197264"
Sep 20 01:07:36.923298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:36.923272    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:37.095981 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.095889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vsh9\" (UniqueName: \"kubernetes.io/projected/452ca7e3-c07d-49ca-83e9-0ffb27e333d5-kube-api-access-9vsh9\") pod \"452ca7e3-c07d-49ca-83e9-0ffb27e333d5\" (UID: \"452ca7e3-c07d-49ca-83e9-0ffb27e333d5\") "
Sep 20 01:07:37.098048 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.098023    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452ca7e3-c07d-49ca-83e9-0ffb27e333d5-kube-api-access-9vsh9" (OuterVolumeSpecName: "kube-api-access-9vsh9") pod "452ca7e3-c07d-49ca-83e9-0ffb27e333d5" (UID: "452ca7e3-c07d-49ca-83e9-0ffb27e333d5"). InnerVolumeSpecName "kube-api-access-9vsh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:37.197063 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.197033    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vsh9\" (UniqueName: \"kubernetes.io/projected/452ca7e3-c07d-49ca-83e9-0ffb27e333d5-kube-api-access-9vsh9\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:37.320813 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.320779    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7605-28e0fb"]
Sep 20 01:07:37.323717 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.323690    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7605-28e0fb"]
Sep 20 01:07:37.437511 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.437481    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7605-5c25f9"]
Sep 20 01:07:37.438014 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.437995    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" containerName="test-curl-7605-28e0fb"
Sep 20 01:07:37.438108 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.438016    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" containerName="test-curl-7605-28e0fb"
Sep 20 01:07:37.438149 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.438131    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" containerName="test-curl-7605-28e0fb"
Sep 20 01:07:37.441371 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.441346    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:37.447082 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.447055    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-5c25f9"]
Sep 20 01:07:37.601737 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.601701    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7t6\" (UniqueName: \"kubernetes.io/projected/fd5e4f3e-8804-49c9-b237-05de0ab52fba-kube-api-access-xj7t6\") pod \"test-curl-7605-5c25f9\" (UID: \"fd5e4f3e-8804-49c9-b237-05de0ab52fba\") " pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:37.702956 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.702852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7t6\" (UniqueName: \"kubernetes.io/projected/fd5e4f3e-8804-49c9-b237-05de0ab52fba-kube-api-access-xj7t6\") pod \"test-curl-7605-5c25f9\" (UID: \"fd5e4f3e-8804-49c9-b237-05de0ab52fba\") " pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:37.711142 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.711113    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7t6\" (UniqueName: \"kubernetes.io/projected/fd5e4f3e-8804-49c9-b237-05de0ab52fba-kube-api-access-xj7t6\") pod \"test-curl-7605-5c25f9\" (UID: \"fd5e4f3e-8804-49c9-b237-05de0ab52fba\") " pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:37.740729 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.740695    2568 generic.go:356] "Generic (PLEG): container finished" podID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" containerID="eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb" exitCode=137
Sep 20 01:07:37.741142 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.740741    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:37.741142 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.740797    2568 scope.go:117] "RemoveContainer" containerID="eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb"
Sep 20 01:07:37.741281 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:37.741228    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7605-28e0fb" container="test-curl-7605-28e0fb"
Sep 20 01:07:37.751911 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.751893    2568 scope.go:117] "RemoveContainer" containerID="eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb"
Sep 20 01:07:37.752201 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:37.752183    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb\": container with ID starting with eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb not found: ID does not exist" containerID="eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb"
Sep 20 01:07:37.752267 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.752209    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb"} err="failed to get container status \"eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb\": rpc error: code = NotFound desc = could not find container \"eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb\": container with ID starting with eabdce40e8bd262cd7c214b15e5969bbcd42df89ba4193af4a3632bbb025c1fb not found: ID does not exist"
Sep 20 01:07:37.752903 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:37.752878    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-772357\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" pod="opendatahub/test-curl-7605-772357"
Sep 20 01:07:37.753927 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.753899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:37.988301 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:37.988219    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452ca7e3-c07d-49ca-83e9-0ffb27e333d5" path="/var/lib/kubelet/pods/452ca7e3-c07d-49ca-83e9-0ffb27e333d5/volumes"
Sep 20 01:07:38.030067 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.030041    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-5c25f9"]
Sep 20 01:07:38.031617 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:07:38.031593    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd5e4f3e_8804_49c9_b237_05de0ab52fba.slice/crio-620dd2cfcfd2b1c05af9550962aba64bdbf6469e983c6cfaf2b769f3c6b31038 WatchSource:0}: Error finding container 620dd2cfcfd2b1c05af9550962aba64bdbf6469e983c6cfaf2b769f3c6b31038: Status 404 returned error can't find the container with id 620dd2cfcfd2b1c05af9550962aba64bdbf6469e983c6cfaf2b769f3c6b31038
Sep 20 01:07:38.654549 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.654502    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"]
Sep 20 01:07:38.654802 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.654756    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl" podUID="8182c8f2-abfc-428b-bfbf-0c94bbb476c5" containerName="maas-api" containerID="cri-o://cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2" gracePeriod=30
Sep 20 01:07:38.754618 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.754566    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-5c25f9" event={"ID":"fd5e4f3e-8804-49c9-b237-05de0ab52fba","Type":"ContainerStarted","Data":"17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b"}
Sep 20 01:07:38.755075 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.754632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-5c25f9" event={"ID":"fd5e4f3e-8804-49c9-b237-05de0ab52fba","Type":"ContainerStarted","Data":"620dd2cfcfd2b1c05af9550962aba64bdbf6469e983c6cfaf2b769f3c6b31038"}
Sep 20 01:07:38.759963 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.756170    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7605-28e0fb" podUID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" containerName="test-curl-7605-28e0fb" containerID="cri-o://5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd" gracePeriod=2
Sep 20 01:07:38.779066 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.778850    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7605-5c25f9" podStartSLOduration=1.778830241 podStartE2EDuration="1.778830241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:38.778030408 +0000 UTC m=+1215.027532213" watchObservedRunningTime="2026-09-20 01:07:38.778830241 +0000 UTC m=+1215.028332048"
Sep 20 01:07:38.926062 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.926039    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:07:38.962694 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:38.962665    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:39.117233 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117200    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-openshift-service-ca\") pod \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") "
Sep 20 01:07:39.117433 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117275    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-metrics-certs\") pod \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") "
Sep 20 01:07:39.117433 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117348    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grk8l\" (UniqueName: \"kubernetes.io/projected/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-kube-api-access-grk8l\") pod \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") "
Sep 20 01:07:39.117433 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117386    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktjwf\" (UniqueName: \"kubernetes.io/projected/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b-kube-api-access-ktjwf\") pod \"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b\" (UID: \"2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b\") "
Sep 20 01:07:39.117598 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117434    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-maas-api-tls\") pod \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\" (UID: \"8182c8f2-abfc-428b-bfbf-0c94bbb476c5\") "
Sep 20 01:07:39.117598 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117559    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8182c8f2-abfc-428b-bfbf-0c94bbb476c5" (UID: "8182c8f2-abfc-428b-bfbf-0c94bbb476c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:07:39.117785 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.117753    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.119421 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.119392    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8182c8f2-abfc-428b-bfbf-0c94bbb476c5" (UID: "8182c8f2-abfc-428b-bfbf-0c94bbb476c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:07:39.119525 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.119455    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-kube-api-access-grk8l" (OuterVolumeSpecName: "kube-api-access-grk8l") pod "8182c8f2-abfc-428b-bfbf-0c94bbb476c5" (UID: "8182c8f2-abfc-428b-bfbf-0c94bbb476c5"). InnerVolumeSpecName "kube-api-access-grk8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:39.119830 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.119812    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b-kube-api-access-ktjwf" (OuterVolumeSpecName: "kube-api-access-ktjwf") pod "2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" (UID: "2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b"). InnerVolumeSpecName "kube-api-access-ktjwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:39.119830 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.119827    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8182c8f2-abfc-428b-bfbf-0c94bbb476c5" (UID: "8182c8f2-abfc-428b-bfbf-0c94bbb476c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:07:39.218594 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.218563    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.218594 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.218596    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grk8l\" (UniqueName: \"kubernetes.io/projected/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-kube-api-access-grk8l\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.218796 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.218611    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktjwf\" (UniqueName: \"kubernetes.io/projected/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b-kube-api-access-ktjwf\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.218796 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.218624    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8182c8f2-abfc-428b-bfbf-0c94bbb476c5-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.372122 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.372084    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7605-5c25f9"]
Sep 20 01:07:39.376499 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.376470    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7605-5c25f9"]
Sep 20 01:07:39.763442 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.763410    2568 generic.go:356] "Generic (PLEG): container finished" podID="8182c8f2-abfc-428b-bfbf-0c94bbb476c5" containerID="cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2" exitCode=0
Sep 20 01:07:39.763890 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.763454    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"
Sep 20 01:07:39.763890 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.763499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl" event={"ID":"8182c8f2-abfc-428b-bfbf-0c94bbb476c5","Type":"ContainerDied","Data":"cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2"}
Sep 20 01:07:39.763890 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.763556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl" event={"ID":"8182c8f2-abfc-428b-bfbf-0c94bbb476c5","Type":"ContainerDied","Data":"d3d0242606d2e6b260eff1048adb3d6bcf3497237bf99bdbda65ef403db54a87"}
Sep 20 01:07:39.763890 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.763588    2568 scope.go:117] "RemoveContainer" containerID="cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2"
Sep 20 01:07:39.765123 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.765083    2568 generic.go:356] "Generic (PLEG): container finished" podID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" containerID="74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe" exitCode=137
Sep 20 01:07:39.765209 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.765133    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:39.765505 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:39.765487    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7605-5c25f9" container="test-curl-7605-5c25f9"
Sep 20 01:07:39.773944 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.773925    2568 scope.go:117] "RemoveContainer" containerID="cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2"
Sep 20 01:07:39.774209 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:39.774187    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2\": container with ID starting with cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2 not found: ID does not exist" containerID="cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2"
Sep 20 01:07:39.774286 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.774216    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2"} err="failed to get container status \"cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2\": rpc error: code = NotFound desc = could not find container \"cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2\": container with ID starting with cfa4c583c13be1929f4771c00d51f959e5718341d5e132b5d76533adbf821eb2 not found: ID does not exist"
Sep 20 01:07:39.774286 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.774233    2568 scope.go:117] "RemoveContainer" containerID="74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe"
Sep 20 01:07:39.783074 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.783053    2568 scope.go:117] "RemoveContainer" containerID="74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe"
Sep 20 01:07:39.783368 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:39.783351    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe\": container with ID starting with 74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe not found: ID does not exist" containerID="74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe"
Sep 20 01:07:39.783427 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.783385    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe"} err="failed to get container status \"74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe\": rpc error: code = NotFound desc = could not find container \"74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe\": container with ID starting with 74cf8d4e11a573d2bea1c1aa22617263d80520f6c74f18206aff1b918ea57ffe not found: ID does not exist"
Sep 20 01:07:39.788788 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.788766    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"]
Sep 20 01:07:39.794759 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:39.794734    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-1c4650\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:39.796080 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:39.796055    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-1c4650\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" pod="opendatahub/test-curl-7605-1c4650"
Sep 20 01:07:39.796680 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.796663    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2fd525-7985b7ffd6-8nfnl"]
Sep 20 01:07:39.989034 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.989001    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b" path="/var/lib/kubelet/pods/2ed6a759-3f2c-4bf6-bdac-df2fb7dc448b/volumes"
Sep 20 01:07:39.989438 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:39.989425    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8182c8f2-abfc-428b-bfbf-0c94bbb476c5" path="/var/lib/kubelet/pods/8182c8f2-abfc-428b-bfbf-0c94bbb476c5/volumes"
Sep 20 01:07:40.774135 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:40.774084    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7605-5c25f9" podUID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" containerName="test-curl-7605-5c25f9" containerID="cri-o://17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b" gracePeriod=2
Sep 20 01:07:40.944396 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:40.944365    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:41.032630 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.032549    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42b4n\" (UniqueName: \"kubernetes.io/projected/9bb817f1-3143-4cc2-8e47-e593291ed2c7-kube-api-access-42b4n\") pod \"9bb817f1-3143-4cc2-8e47-e593291ed2c7\" (UID: \"9bb817f1-3143-4cc2-8e47-e593291ed2c7\") "
Sep 20 01:07:41.034794 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.034767    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb817f1-3143-4cc2-8e47-e593291ed2c7-kube-api-access-42b4n" (OuterVolumeSpecName: "kube-api-access-42b4n") pod "9bb817f1-3143-4cc2-8e47-e593291ed2c7" (UID: "9bb817f1-3143-4cc2-8e47-e593291ed2c7"). InnerVolumeSpecName "kube-api-access-42b4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:41.133508 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.133470    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42b4n\" (UniqueName: \"kubernetes.io/projected/9bb817f1-3143-4cc2-8e47-e593291ed2c7-kube-api-access-42b4n\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:41.781486 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.781453    2568 generic.go:356] "Generic (PLEG): container finished" podID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" containerID="5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd" exitCode=137
Sep 20 01:07:41.781903 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.781556    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:41.781903 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.781568    2568 scope.go:117] "RemoveContainer" containerID="5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd"
Sep 20 01:07:41.790813 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.790798    2568 scope.go:117] "RemoveContainer" containerID="5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd"
Sep 20 01:07:41.791149 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:41.791122    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd\": container with ID starting with 5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd not found: ID does not exist" containerID="5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd"
Sep 20 01:07:41.791240 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.791160    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd"} err="failed to get container status \"5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd\": rpc error: code = NotFound desc = could not find container \"5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd\": container with ID starting with 5644ad7ec9111aaaaab091ca4960e81a12dddcdacc5c2f726f4fde8d3f7018bd not found: ID does not exist"
Sep 20 01:07:41.791240 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:41.791130    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-28e0fb\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" pod="opendatahub/test-curl-7605-28e0fb"
Sep 20 01:07:41.988328 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:41.988296    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bb817f1-3143-4cc2-8e47-e593291ed2c7" path="/var/lib/kubelet/pods/9bb817f1-3143-4cc2-8e47-e593291ed2c7/volumes"
Sep 20 01:07:42.967976 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:42.967941    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:43.052382 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.052288    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj7t6\" (UniqueName: \"kubernetes.io/projected/fd5e4f3e-8804-49c9-b237-05de0ab52fba-kube-api-access-xj7t6\") pod \"fd5e4f3e-8804-49c9-b237-05de0ab52fba\" (UID: \"fd5e4f3e-8804-49c9-b237-05de0ab52fba\") "
Sep 20 01:07:43.054380 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.054352    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5e4f3e-8804-49c9-b237-05de0ab52fba-kube-api-access-xj7t6" (OuterVolumeSpecName: "kube-api-access-xj7t6") pod "fd5e4f3e-8804-49c9-b237-05de0ab52fba" (UID: "fd5e4f3e-8804-49c9-b237-05de0ab52fba"). InnerVolumeSpecName "kube-api-access-xj7t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:43.153284 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.153238    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj7t6\" (UniqueName: \"kubernetes.io/projected/fd5e4f3e-8804-49c9-b237-05de0ab52fba-kube-api-access-xj7t6\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:07:43.796415 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.796374    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" containerID="17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b" exitCode=137
Sep 20 01:07:43.796415 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.796419    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:43.796733 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.796448    2568 scope.go:117] "RemoveContainer" containerID="17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b"
Sep 20 01:07:43.806461 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.806441    2568 scope.go:117] "RemoveContainer" containerID="17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b"
Sep 20 01:07:43.806759 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:43.806743    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b\": container with ID starting with 17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b not found: ID does not exist" containerID="17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b"
Sep 20 01:07:43.806849 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.806767    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b"} err="failed to get container status \"17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b\": rpc error: code = NotFound desc = could not find container \"17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b\": container with ID starting with 17235737ea9d2df885c6d66d69447e4859321a230c97b59aace6a3b45a2cc56b not found: ID does not exist"
Sep 20 01:07:43.807347 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:07:43.807326    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-5c25f9\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" pod="opendatahub/test-curl-7605-5c25f9"
Sep 20 01:07:43.987660 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:43.987628    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" path="/var/lib/kubelet/pods/fd5e4f3e-8804-49c9-b237-05de0ab52fba/volumes"
Sep 20 01:07:47.696217 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696185    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"]
Sep 20 01:07:47.696721 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696679    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" containerName="test-curl-7605-5c25f9"
Sep 20 01:07:47.696721 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696694    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" containerName="test-curl-7605-5c25f9"
Sep 20 01:07:47.696721 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696707    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8182c8f2-abfc-428b-bfbf-0c94bbb476c5" containerName="maas-api"
Sep 20 01:07:47.696721 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696713    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8182c8f2-abfc-428b-bfbf-0c94bbb476c5" containerName="maas-api"
Sep 20 01:07:47.696995 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696813    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8182c8f2-abfc-428b-bfbf-0c94bbb476c5" containerName="maas-api"
Sep 20 01:07:47.696995 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.696823    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5e4f3e-8804-49c9-b237-05de0ab52fba" containerName="test-curl-7605-5c25f9"
Sep 20 01:07:47.699906 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.699883    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.702231 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.702210    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8b864c4f-serving-cert\""
Sep 20 01:07:47.709267 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.708706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"]
Sep 20 01:07:47.801886 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.801857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75225\" (UniqueName: \"kubernetes.io/projected/d902af20-b7f4-4c79-a9ab-760bc97e66b1-kube-api-access-75225\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.802087 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.801896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d902af20-b7f4-4c79-a9ab-760bc97e66b1-openshift-service-ca\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.802087 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.802005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-maas-api-tls\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.802087 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.802047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-metrics-certs\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.902938 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.902885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75225\" (UniqueName: \"kubernetes.io/projected/d902af20-b7f4-4c79-a9ab-760bc97e66b1-kube-api-access-75225\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.903144 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.902960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d902af20-b7f4-4c79-a9ab-760bc97e66b1-openshift-service-ca\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.903144 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.903001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-maas-api-tls\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.903144 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.903028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-metrics-certs\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.903783 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.903754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d902af20-b7f4-4c79-a9ab-760bc97e66b1-openshift-service-ca\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.905621 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.905590    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-maas-api-tls\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.905723 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.905670    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-metrics-certs\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:47.910255 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:47.910233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75225\" (UniqueName: \"kubernetes.io/projected/d902af20-b7f4-4c79-a9ab-760bc97e66b1-kube-api-access-75225\") pod \"maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:48.013747 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:48.013668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:48.287764 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:48.287736    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"]
Sep 20 01:07:48.289028 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:07:48.288993    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd902af20_b7f4_4c79_a9ab_760bc97e66b1.slice/crio-5aa6373792f78764b0c25d9b9cb3d03e3a4c379fc43d4b1d1758a1277f65c337 WatchSource:0}: Error finding container 5aa6373792f78764b0c25d9b9cb3d03e3a4c379fc43d4b1d1758a1277f65c337: Status 404 returned error can't find the container with id 5aa6373792f78764b0c25d9b9cb3d03e3a4c379fc43d4b1d1758a1277f65c337
Sep 20 01:07:48.837041 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:48.837007    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd" event={"ID":"d902af20-b7f4-4c79-a9ab-760bc97e66b1","Type":"ContainerStarted","Data":"5aa6373792f78764b0c25d9b9cb3d03e3a4c379fc43d4b1d1758a1277f65c337"}
Sep 20 01:07:49.846143 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:49.846106    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd" event={"ID":"d902af20-b7f4-4c79-a9ab-760bc97e66b1","Type":"ContainerStarted","Data":"8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d"}
Sep 20 01:07:49.846691 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:49.846304    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:07:49.862533 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:49.862488    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd" podStartSLOduration=2.346193917 podStartE2EDuration="2.862473132s" totalImagesPullingTime="516.279215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:49.860008038 +0000 UTC m=+1226.109509841" watchObservedRunningTime="2026-09-20 01:07:49.862473132 +0000 UTC m=+1226.111974936"
Sep 20 01:07:55.857570 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:07:55.857538    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:08:32.469277 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.469244    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"]
Sep 20 01:08:32.469697 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.469459    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" podUID="c8ec076a-0049-46fc-81ed-6ef45bab433f" containerName="maas-api" containerID="cri-o://89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa" gracePeriod=30
Sep 20 01:08:32.736111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.736041    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:08:32.857868 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.857822    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-metrics-certs\") pod \"c8ec076a-0049-46fc-81ed-6ef45bab433f\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") "
Sep 20 01:08:32.858075 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.857965    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") pod \"c8ec076a-0049-46fc-81ed-6ef45bab433f\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") "
Sep 20 01:08:32.858075 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.858025    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rjqw\" (UniqueName: \"kubernetes.io/projected/c8ec076a-0049-46fc-81ed-6ef45bab433f-kube-api-access-9rjqw\") pod \"c8ec076a-0049-46fc-81ed-6ef45bab433f\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") "
Sep 20 01:08:32.858075 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.858064    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ec076a-0049-46fc-81ed-6ef45bab433f-openshift-service-ca\") pod \"c8ec076a-0049-46fc-81ed-6ef45bab433f\" (UID: \"c8ec076a-0049-46fc-81ed-6ef45bab433f\") "
Sep 20 01:08:32.867444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.858706    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ec076a-0049-46fc-81ed-6ef45bab433f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8ec076a-0049-46fc-81ed-6ef45bab433f" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:32.867444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.865699    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c8ec076a-0049-46fc-81ed-6ef45bab433f" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:08:32.867444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.866536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ec076a-0049-46fc-81ed-6ef45bab433f-kube-api-access-9rjqw" (OuterVolumeSpecName: "kube-api-access-9rjqw") pod "c8ec076a-0049-46fc-81ed-6ef45bab433f" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f"). InnerVolumeSpecName "kube-api-access-9rjqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:32.867444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.866719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8ec076a-0049-46fc-81ed-6ef45bab433f" (UID: "c8ec076a-0049-46fc-81ed-6ef45bab433f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:08:32.959694 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.959654    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ec076a-0049-46fc-81ed-6ef45bab433f-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:08:32.959694 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.959687    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:08:32.959694 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.959696    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ec076a-0049-46fc-81ed-6ef45bab433f-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:08:32.959962 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:32.959706    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rjqw\" (UniqueName: \"kubernetes.io/projected/c8ec076a-0049-46fc-81ed-6ef45bab433f-kube-api-access-9rjqw\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:08:33.114285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.114195    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8ec076a-0049-46fc-81ed-6ef45bab433f" containerID="89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa" exitCode=0
Sep 20 01:08:33.114285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.114241    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"
Sep 20 01:08:33.114494 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.114284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" event={"ID":"c8ec076a-0049-46fc-81ed-6ef45bab433f","Type":"ContainerDied","Data":"89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa"}
Sep 20 01:08:33.114494 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.114337    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z" event={"ID":"c8ec076a-0049-46fc-81ed-6ef45bab433f","Type":"ContainerDied","Data":"0c2e417ce6da3af359d24bd2534d58333e767a5e1d1bb9ba53c01a855198b67d"}
Sep 20 01:08:33.114494 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.114359    2568 scope.go:117] "RemoveContainer" containerID="89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa"
Sep 20 01:08:33.125123 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.125095    2568 scope.go:117] "RemoveContainer" containerID="89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa"
Sep 20 01:08:33.125372 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:08:33.125356    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa\": container with ID starting with 89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa not found: ID does not exist" containerID="89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa"
Sep 20 01:08:33.125414 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.125383    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa"} err="failed to get container status \"89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa\": rpc error: code = NotFound desc = could not find container \"89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa\": container with ID starting with 89830a741d7332672411c41faa81b8552530f318737975beaa9551740028c4aa not found: ID does not exist"
Sep 20 01:08:33.137663 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.137636    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"]
Sep 20 01:08:33.143957 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.143928    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-376bcf-74f7966bb4-ms22z"]
Sep 20 01:08:33.989095 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:33.989063    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ec076a-0049-46fc-81ed-6ef45bab433f" path="/var/lib/kubelet/pods/c8ec076a-0049-46fc-81ed-6ef45bab433f/volumes"
Sep 20 01:08:47.516672 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.516633    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"]
Sep 20 01:08:47.517181 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.517108    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ec076a-0049-46fc-81ed-6ef45bab433f" containerName="maas-api"
Sep 20 01:08:47.517181 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.517123    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ec076a-0049-46fc-81ed-6ef45bab433f" containerName="maas-api"
Sep 20 01:08:47.517312 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.517187    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ec076a-0049-46fc-81ed-6ef45bab433f" containerName="maas-api"
Sep 20 01:08:47.520159 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.520140    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.522233 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.522212    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-d1662a-serving-cert\""
Sep 20 01:08:47.531139 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.531088    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"]
Sep 20 01:08:47.607094 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.607058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.607094 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.607099    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.607316 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.607201    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqxt\" (UniqueName: \"kubernetes.io/projected/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-kube-api-access-gpqxt\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.607316 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.607241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.707932 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.707876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.708138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.707991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.708138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.708022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.708138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.708099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqxt\" (UniqueName: \"kubernetes.io/projected/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-kube-api-access-gpqxt\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.708731 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.708703    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.710428 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.710404    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.710538 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.710474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.715334 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.715310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqxt\" (UniqueName: \"kubernetes.io/projected/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-kube-api-access-gpqxt\") pod \"maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:47.834765 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:47.834668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:48.111025 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:48.110998    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"]
Sep 20 01:08:48.113279 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:08:48.113253    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1c3527_b0e1_4e4f_881b_da6a5ca8ee18.slice/crio-fcebe33d64076e7f8fd80f14ff04a122d415e28856f6bbe1e791f93c72abb3f0 WatchSource:0}: Error finding container fcebe33d64076e7f8fd80f14ff04a122d415e28856f6bbe1e791f93c72abb3f0: Status 404 returned error can't find the container with id fcebe33d64076e7f8fd80f14ff04a122d415e28856f6bbe1e791f93c72abb3f0
Sep 20 01:08:48.214823 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:48.214787    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r" event={"ID":"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18","Type":"ContainerStarted","Data":"fcebe33d64076e7f8fd80f14ff04a122d415e28856f6bbe1e791f93c72abb3f0"}
Sep 20 01:08:49.222440 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:49.222402    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r" event={"ID":"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18","Type":"ContainerStarted","Data":"1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648"}
Sep 20 01:08:49.222830 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:49.222483    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:08:49.239691 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:49.239637    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r" podStartSLOduration=1.8065258800000001 podStartE2EDuration="2.239622208s" totalImagesPullingTime="433.096328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:08:49.237574492 +0000 UTC m=+1285.487076296" watchObservedRunningTime="2026-09-20 01:08:49.239622208 +0000 UTC m=+1285.489124011"
Sep 20 01:08:55.234058 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:08:55.234028    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:09:21.907145 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:21.907113    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"]
Sep 20 01:09:21.911056 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:21.911027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:21.913076 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:21.913054    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-4c93ee-serving-cert\""
Sep 20 01:09:21.922021 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:21.921992    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"]
Sep 20 01:09:22.056259 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.056220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djx8f\" (UniqueName: \"kubernetes.io/projected/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-kube-api-access-djx8f\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.056259 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.056267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.056491 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.056349    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.056491 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.056405    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.157491 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.157409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.157652 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.157501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djx8f\" (UniqueName: \"kubernetes.io/projected/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-kube-api-access-djx8f\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.157652 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.157552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.157652 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.157605    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.158296 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.158276    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.160155 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.160123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.160290 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.160123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.166372 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.166352    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djx8f\" (UniqueName: \"kubernetes.io/projected/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-kube-api-access-djx8f\") pod \"maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.224296 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.224255    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:22.501708 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.501678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"]
Sep 20 01:09:22.502882 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:09:22.502859    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72726f1e_1f54_4c8b_ab43_fc80f9208ddd.slice/crio-d54f2bb2aa3c2a915dc2774bc8d616b72726e3b551be563a2a56d36035793e58 WatchSource:0}: Error finding container d54f2bb2aa3c2a915dc2774bc8d616b72726e3b551be563a2a56d36035793e58: Status 404 returned error can't find the container with id d54f2bb2aa3c2a915dc2774bc8d616b72726e3b551be563a2a56d36035793e58
Sep 20 01:09:22.504312 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:22.504290    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:09:23.442509 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:23.442470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp" event={"ID":"72726f1e-1f54-4c8b-ab43-fc80f9208ddd","Type":"ContainerStarted","Data":"7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe"}
Sep 20 01:09:23.443037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:23.442541    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp" event={"ID":"72726f1e-1f54-4c8b-ab43-fc80f9208ddd","Type":"ContainerStarted","Data":"d54f2bb2aa3c2a915dc2774bc8d616b72726e3b551be563a2a56d36035793e58"}
Sep 20 01:09:23.443037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:23.442747    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:23.458285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:23.458238    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp" podStartSLOduration=2.063299014 podStartE2EDuration="2.458223571s" totalImagesPullingTime="394.924557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:09:23.457009236 +0000 UTC m=+1319.706511042" watchObservedRunningTime="2026-09-20 01:09:23.458223571 +0000 UTC m=+1319.707725374"
Sep 20 01:09:25.282148 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.282108    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"]
Sep 20 01:09:25.285989 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.285965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.288643 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.288623    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"distinct-2-w0-e2e8bc-kserve-self-signed-certs\""
Sep 20 01:09:25.295302 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.295280    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"]
Sep 20 01:09:25.391806 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.391766    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-model-cache\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.392037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.391810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-home\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.392037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.391850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-tmp-dir\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.392037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.391894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6514e24-f3a1-4d1d-8664-1017d0844902-tls-certs\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.392037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.391987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-dshm\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.392037 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.392033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vnbr\" (UniqueName: \"kubernetes.io/projected/c6514e24-f3a1-4d1d-8664-1017d0844902-kube-api-access-8vnbr\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.492905 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.492868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vnbr\" (UniqueName: \"kubernetes.io/projected/c6514e24-f3a1-4d1d-8664-1017d0844902-kube-api-access-8vnbr\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493124 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-model-cache\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493124 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-home\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493124 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-tmp-dir\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493124 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6514e24-f3a1-4d1d-8664-1017d0844902-tls-certs\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493313 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-dshm\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493432 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493411    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-model-cache\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493494 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-tmp-dir\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.493494 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.493485    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-home\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.495408 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.495384    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-dshm\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.495546 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.495528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6514e24-f3a1-4d1d-8664-1017d0844902-tls-certs\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.500145 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.500120    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vnbr\" (UniqueName: \"kubernetes.io/projected/c6514e24-f3a1-4d1d-8664-1017d0844902-kube-api-access-8vnbr\") pod \"distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") " pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.602614 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.602521    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:25.878865 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:25.878824    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"]
Sep 20 01:09:25.879532 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:09:25.879502    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6514e24_f3a1_4d1d_8664_1017d0844902.slice/crio-67596fab6acdf5116c3165e40428c43655f29041b9e9360376904ea938570a65 WatchSource:0}: Error finding container 67596fab6acdf5116c3165e40428c43655f29041b9e9360376904ea938570a65: Status 404 returned error can't find the container with id 67596fab6acdf5116c3165e40428c43655f29041b9e9360376904ea938570a65
Sep 20 01:09:26.465361 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:26.465277    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb" event={"ID":"c6514e24-f3a1-4d1d-8664-1017d0844902","Type":"ContainerStarted","Data":"42f0245672fb88a7d9eb38c1c77d17e77b1e3d6f0f1bfa38665d7aec4a8c68b5"}
Sep 20 01:09:26.465361 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:26.465320    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb" event={"ID":"c6514e24-f3a1-4d1d-8664-1017d0844902","Type":"ContainerStarted","Data":"67596fab6acdf5116c3165e40428c43655f29041b9e9360376904ea938570a65"}
Sep 20 01:09:26.479933 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:26.479874    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb" podStartSLOduration=1.479860768 podStartE2EDuration="1.479860768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:09:26.478419647 +0000 UTC m=+1322.727921461" watchObservedRunningTime="2026-09-20 01:09:26.479860768 +0000 UTC m=+1322.729362572"
Sep 20 01:09:29.455601 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:29.455569    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:09:35.603405 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:35.603355    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:35.603979 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:35.603630    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:35.616302 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:35.616272    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:09:36.538801 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:09:36.538772    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:10:21.250439 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.250399    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"]
Sep 20 01:10:21.251064 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.250669    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd" podUID="d902af20-b7f4-4c79-a9ab-760bc97e66b1" containerName="maas-api" containerID="cri-o://8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d" gracePeriod=30
Sep 20 01:10:21.513735 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.513680    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:10:21.538790 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.538743    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d902af20-b7f4-4c79-a9ab-760bc97e66b1-openshift-service-ca\") pod \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") "
Sep 20 01:10:21.539028 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.538958    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75225\" (UniqueName: \"kubernetes.io/projected/d902af20-b7f4-4c79-a9ab-760bc97e66b1-kube-api-access-75225\") pod \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") "
Sep 20 01:10:21.539143 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.539110    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-metrics-certs\") pod \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") "
Sep 20 01:10:21.539212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.539146    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-maas-api-tls\") pod \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\" (UID: \"d902af20-b7f4-4c79-a9ab-760bc97e66b1\") "
Sep 20 01:10:21.539953 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.539853    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d902af20-b7f4-4c79-a9ab-760bc97e66b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d902af20-b7f4-4c79-a9ab-760bc97e66b1" (UID: "d902af20-b7f4-4c79-a9ab-760bc97e66b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:10:21.542172 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.542131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d902af20-b7f4-4c79-a9ab-760bc97e66b1-kube-api-access-75225" (OuterVolumeSpecName: "kube-api-access-75225") pod "d902af20-b7f4-4c79-a9ab-760bc97e66b1" (UID: "d902af20-b7f4-4c79-a9ab-760bc97e66b1"). InnerVolumeSpecName "kube-api-access-75225". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:10:21.543734 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.543699    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d902af20-b7f4-4c79-a9ab-760bc97e66b1" (UID: "d902af20-b7f4-4c79-a9ab-760bc97e66b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:10:21.543954 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.543898    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d902af20-b7f4-4c79-a9ab-760bc97e66b1" (UID: "d902af20-b7f4-4c79-a9ab-760bc97e66b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:10:21.641216 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.641172    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75225\" (UniqueName: \"kubernetes.io/projected/d902af20-b7f4-4c79-a9ab-760bc97e66b1-kube-api-access-75225\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.641216 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.641212    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.641468 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.641226    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d902af20-b7f4-4c79-a9ab-760bc97e66b1-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.641468 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.641240    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d902af20-b7f4-4c79-a9ab-760bc97e66b1-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.802724 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.802634    2568 generic.go:356] "Generic (PLEG): container finished" podID="d902af20-b7f4-4c79-a9ab-760bc97e66b1" containerID="8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d" exitCode=0
Sep 20 01:10:21.802724 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.802691    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"
Sep 20 01:10:21.802963 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.802725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd" event={"ID":"d902af20-b7f4-4c79-a9ab-760bc97e66b1","Type":"ContainerDied","Data":"8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d"}
Sep 20 01:10:21.802963 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.802802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd" event={"ID":"d902af20-b7f4-4c79-a9ab-760bc97e66b1","Type":"ContainerDied","Data":"5aa6373792f78764b0c25d9b9cb3d03e3a4c379fc43d4b1d1758a1277f65c337"}
Sep 20 01:10:21.802963 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.802823    2568 scope.go:117] "RemoveContainer" containerID="8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d"
Sep 20 01:10:21.813028 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.813007    2568 scope.go:117] "RemoveContainer" containerID="8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d"
Sep 20 01:10:21.813325 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:10:21.813305    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d\": container with ID starting with 8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d not found: ID does not exist" containerID="8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d"
Sep 20 01:10:21.813389 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.813335    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d"} err="failed to get container status \"8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d\": rpc error: code = NotFound desc = could not find container \"8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d\": container with ID starting with 8a74bfdcfa0831842e2fc1a0d58650308e24084814174709c38c9d809403218d not found: ID does not exist"
Sep 20 01:10:21.826888 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.826863    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"]
Sep 20 01:10:21.837708 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.837684    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8b864c4f-6c58589f9c-bjvqd"]
Sep 20 01:10:21.988378 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:10:21.988344    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d902af20-b7f4-4c79-a9ab-760bc97e66b1" path="/var/lib/kubelet/pods/d902af20-b7f4-4c79-a9ab-760bc97e66b1/volumes"
Sep 20 01:12:14.517261 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.517225    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"]
Sep 20 01:12:14.517697 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.517684    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d902af20-b7f4-4c79-a9ab-760bc97e66b1" containerName="maas-api"
Sep 20 01:12:14.517746 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.517699    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d902af20-b7f4-4c79-a9ab-760bc97e66b1" containerName="maas-api"
Sep 20 01:12:14.517784 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.517769    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d902af20-b7f4-4c79-a9ab-760bc97e66b1" containerName="maas-api"
Sep 20 01:12:14.521084 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.521068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.523121 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.523092    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a5f8d9-serving-cert\""
Sep 20 01:12:14.530292 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.530260    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"]
Sep 20 01:12:14.643526 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.643479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46c28\" (UniqueName: \"kubernetes.io/projected/4cf86854-546f-4d23-84f8-31c7ddda20e9-kube-api-access-46c28\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.643715 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.643545    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.643715 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.643623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-metrics-certs\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.643804 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.643771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf86854-546f-4d23-84f8-31c7ddda20e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.744859 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.744813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-metrics-certs\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.745089 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.744983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf86854-546f-4d23-84f8-31c7ddda20e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.745089 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.745040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46c28\" (UniqueName: \"kubernetes.io/projected/4cf86854-546f-4d23-84f8-31c7ddda20e9-kube-api-access-46c28\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.745089 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.745075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.745261 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:12:14.745208    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-serving-cert: secret "maas-api-e2e-api-a-a5f8d9-serving-cert" not found
Sep 20 01:12:14.745320 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:12:14.745293    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls podName:4cf86854-546f-4d23-84f8-31c7ddda20e9 nodeName:}" failed. No retries permitted until 2026-09-20 01:12:15.245268829 +0000 UTC m=+1491.494770616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls") pod "maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" (UID: "4cf86854-546f-4d23-84f8-31c7ddda20e9") : secret "maas-api-e2e-api-a-a5f8d9-serving-cert" not found
Sep 20 01:12:14.745704 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.745679    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf86854-546f-4d23-84f8-31c7ddda20e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.747572 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.747551    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-metrics-certs\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:14.758290 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:14.758260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46c28\" (UniqueName: \"kubernetes.io/projected/4cf86854-546f-4d23-84f8-31c7ddda20e9-kube-api-access-46c28\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:15.251799 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:15.251765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:15.254480 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:15.254453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls\") pod \"maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:15.435889 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:15.435850    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:15.714141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:15.714112    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"]
Sep 20 01:12:15.715396 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:12:15.715371    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf86854_546f_4d23_84f8_31c7ddda20e9.slice/crio-0d73647575239b390509a301e415446552ab4bf98cfe3868688f85a4b182351c WatchSource:0}: Error finding container 0d73647575239b390509a301e415446552ab4bf98cfe3868688f85a4b182351c: Status 404 returned error can't find the container with id 0d73647575239b390509a301e415446552ab4bf98cfe3868688f85a4b182351c
Sep 20 01:12:16.510357 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:16.510320    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" event={"ID":"4cf86854-546f-4d23-84f8-31c7ddda20e9","Type":"ContainerStarted","Data":"a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4"}
Sep 20 01:12:16.510549 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:16.510379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" event={"ID":"4cf86854-546f-4d23-84f8-31c7ddda20e9","Type":"ContainerStarted","Data":"0d73647575239b390509a301e415446552ab4bf98cfe3868688f85a4b182351c"}
Sep 20 01:12:16.510549 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:16.510475    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:16.529860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:16.529777    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" podStartSLOduration=1.93349259 podStartE2EDuration="2.529751319s" totalImagesPullingTime="596.258729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:16.529441356 +0000 UTC m=+1492.778943167" watchObservedRunningTime="2026-09-20 01:12:16.529751319 +0000 UTC m=+1492.779253123"
Sep 20 01:12:22.522831 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:22.522799    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:12:26.132174 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:26.132145    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:12:26.145225 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:26.145193    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:12:49.361032 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.360935    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"]
Sep 20 01:12:49.365560 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.365535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.367469 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.367442    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-bc4088-serving-cert\""
Sep 20 01:12:49.375148 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.374583    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"]
Sep 20 01:12:49.503008 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.502970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccecd875-4b60-48ab-8f90-944cd4e6ed80-openshift-service-ca\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.503191 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.503022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-maas-api-tls\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.503191 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.503117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-metrics-certs\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.503272 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.503218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbhn\" (UniqueName: \"kubernetes.io/projected/ccecd875-4b60-48ab-8f90-944cd4e6ed80-kube-api-access-pxbhn\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.604452 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.604417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbhn\" (UniqueName: \"kubernetes.io/projected/ccecd875-4b60-48ab-8f90-944cd4e6ed80-kube-api-access-pxbhn\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.604624 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.604473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccecd875-4b60-48ab-8f90-944cd4e6ed80-openshift-service-ca\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.604624 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.604499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-maas-api-tls\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.604624 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.604528    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-metrics-certs\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.605209 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.605184    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccecd875-4b60-48ab-8f90-944cd4e6ed80-openshift-service-ca\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.607016 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.606994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-metrics-certs\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.607173 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.607152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-maas-api-tls\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.616211 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.616151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbhn\" (UniqueName: \"kubernetes.io/projected/ccecd875-4b60-48ab-8f90-944cd4e6ed80-kube-api-access-pxbhn\") pod \"maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.680629 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.680598    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:49.959902 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:49.959871    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"]
Sep 20 01:12:49.960059 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:12:49.959954    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccecd875_4b60_48ab_8f90_944cd4e6ed80.slice/crio-26a07dd66338f4830479f814a4e651066214bb3b3ece4189af34ec425c7fdd79 WatchSource:0}: Error finding container 26a07dd66338f4830479f814a4e651066214bb3b3ece4189af34ec425c7fdd79: Status 404 returned error can't find the container with id 26a07dd66338f4830479f814a4e651066214bb3b3ece4189af34ec425c7fdd79
Sep 20 01:12:50.723971 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:50.723906    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff" event={"ID":"ccecd875-4b60-48ab-8f90-944cd4e6ed80","Type":"ContainerStarted","Data":"8d2cacd596c56e2ead0e845c9f2384cb0797ed8f4338b511eba8f8812b329ba7"}
Sep 20 01:12:50.724420 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:50.724017    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:12:50.724420 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:50.724034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff" event={"ID":"ccecd875-4b60-48ab-8f90-944cd4e6ed80","Type":"ContainerStarted","Data":"26a07dd66338f4830479f814a4e651066214bb3b3ece4189af34ec425c7fdd79"}
Sep 20 01:12:50.741768 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:50.741701    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff" podStartSLOduration=1.421866054 podStartE2EDuration="1.741680332s" totalImagesPullingTime="319.814278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:50.73901365 +0000 UTC m=+1526.988515453" watchObservedRunningTime="2026-09-20 01:12:50.741680332 +0000 UTC m=+1526.991182137"
Sep 20 01:12:54.750522 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:54.750490    2568 generic.go:356] "Generic (PLEG): container finished" podID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerID="5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e" exitCode=137
Sep 20 01:12:54.750975 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:54.750558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" event={"ID":"1a7551ec-27ab-43e5-a675-c627df0bf4b4","Type":"ContainerDied","Data":"5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"}
Sep 20 01:12:54.750975 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:54.750949    2568 scope.go:117] "RemoveContainer" containerID="5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"
Sep 20 01:12:55.762760 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:55.762722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" event={"ID":"1a7551ec-27ab-43e5-a675-c627df0bf4b4","Type":"ContainerStarted","Data":"2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6"}
Sep 20 01:12:55.763156 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:55.762978    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 01:12:56.735960 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:12:56.735907    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:13:06.776168 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:06.776133    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 01:13:32.713585 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.713548    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"]
Sep 20 01:13:32.716183 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.713763    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" podUID="4cf86854-546f-4d23-84f8-31c7ddda20e9" containerName="maas-api" containerID="cri-o://a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4" gracePeriod=30
Sep 20 01:13:32.983446 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.983418    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:13:32.999796 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.999767    2568 generic.go:356] "Generic (PLEG): container finished" podID="4cf86854-546f-4d23-84f8-31c7ddda20e9" containerID="a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4" exitCode=0
Sep 20 01:13:33.000008 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.999831    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"
Sep 20 01:13:33.000008 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.999861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" event={"ID":"4cf86854-546f-4d23-84f8-31c7ddda20e9","Type":"ContainerDied","Data":"a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4"}
Sep 20 01:13:33.000008 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:32.999975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9" event={"ID":"4cf86854-546f-4d23-84f8-31c7ddda20e9","Type":"ContainerDied","Data":"0d73647575239b390509a301e415446552ab4bf98cfe3868688f85a4b182351c"}
Sep 20 01:13:33.000208 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.000003    2568 scope.go:117] "RemoveContainer" containerID="a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4"
Sep 20 01:13:33.013954 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.013904    2568 scope.go:117] "RemoveContainer" containerID="a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4"
Sep 20 01:13:33.014311 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:13:33.014292    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4\": container with ID starting with a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4 not found: ID does not exist" containerID="a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4"
Sep 20 01:13:33.014375 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.014323    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4"} err="failed to get container status \"a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4\": rpc error: code = NotFound desc = could not find container \"a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4\": container with ID starting with a27f1bf0dacffdbf04e73bf08b37106e3fdd769a107dc861bb729a0bf9b6a9a4 not found: ID does not exist"
Sep 20 01:13:33.143974 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.143495    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf86854-546f-4d23-84f8-31c7ddda20e9-openshift-service-ca\") pod \"4cf86854-546f-4d23-84f8-31c7ddda20e9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") "
Sep 20 01:13:33.143974 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.143600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46c28\" (UniqueName: \"kubernetes.io/projected/4cf86854-546f-4d23-84f8-31c7ddda20e9-kube-api-access-46c28\") pod \"4cf86854-546f-4d23-84f8-31c7ddda20e9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") "
Sep 20 01:13:33.143974 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.143655    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls\") pod \"4cf86854-546f-4d23-84f8-31c7ddda20e9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") "
Sep 20 01:13:33.143974 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.143711    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-metrics-certs\") pod \"4cf86854-546f-4d23-84f8-31c7ddda20e9\" (UID: \"4cf86854-546f-4d23-84f8-31c7ddda20e9\") "
Sep 20 01:13:33.144345 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.144088    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf86854-546f-4d23-84f8-31c7ddda20e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4cf86854-546f-4d23-84f8-31c7ddda20e9" (UID: "4cf86854-546f-4d23-84f8-31c7ddda20e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:33.144345 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.144262    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf86854-546f-4d23-84f8-31c7ddda20e9-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.146658 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.146629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4cf86854-546f-4d23-84f8-31c7ddda20e9" (UID: "4cf86854-546f-4d23-84f8-31c7ddda20e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:13:33.146862 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.146837    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf86854-546f-4d23-84f8-31c7ddda20e9-kube-api-access-46c28" (OuterVolumeSpecName: "kube-api-access-46c28") pod "4cf86854-546f-4d23-84f8-31c7ddda20e9" (UID: "4cf86854-546f-4d23-84f8-31c7ddda20e9"). InnerVolumeSpecName "kube-api-access-46c28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:33.147075 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.147058    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4cf86854-546f-4d23-84f8-31c7ddda20e9" (UID: "4cf86854-546f-4d23-84f8-31c7ddda20e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:13:33.245646 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.245571    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46c28\" (UniqueName: \"kubernetes.io/projected/4cf86854-546f-4d23-84f8-31c7ddda20e9-kube-api-access-46c28\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.245646 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.245599    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.245646 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.245611    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cf86854-546f-4d23-84f8-31c7ddda20e9-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.321092 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.321053    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"]
Sep 20 01:13:33.324983 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.324959    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a5f8d9-5df67d8466-7gzk9"]
Sep 20 01:13:33.988509 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:33.988476    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cf86854-546f-4d23-84f8-31c7ddda20e9" path="/var/lib/kubelet/pods/4cf86854-546f-4d23-84f8-31c7ddda20e9/volumes"
Sep 20 01:13:53.893867 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:53.893823    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"]
Sep 20 01:13:53.894761 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:53.894704    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff" podUID="ccecd875-4b60-48ab-8f90-944cd4e6ed80" containerName="maas-api" containerID="cri-o://8d2cacd596c56e2ead0e845c9f2384cb0797ed8f4338b511eba8f8812b329ba7" gracePeriod=30
Sep 20 01:13:54.137127 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.137091    2568 generic.go:356] "Generic (PLEG): container finished" podID="ccecd875-4b60-48ab-8f90-944cd4e6ed80" containerID="8d2cacd596c56e2ead0e845c9f2384cb0797ed8f4338b511eba8f8812b329ba7" exitCode=0
Sep 20 01:13:54.137299 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.137158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff" event={"ID":"ccecd875-4b60-48ab-8f90-944cd4e6ed80","Type":"ContainerDied","Data":"8d2cacd596c56e2ead0e845c9f2384cb0797ed8f4338b511eba8f8812b329ba7"}
Sep 20 01:13:54.176012 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.175988    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:13:54.257895 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.257859    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-metrics-certs\") pod \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") "
Sep 20 01:13:54.258093 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.258073    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccecd875-4b60-48ab-8f90-944cd4e6ed80-openshift-service-ca\") pod \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") "
Sep 20 01:13:54.258156 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.258128    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-maas-api-tls\") pod \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") "
Sep 20 01:13:54.258220 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.258205    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxbhn\" (UniqueName: \"kubernetes.io/projected/ccecd875-4b60-48ab-8f90-944cd4e6ed80-kube-api-access-pxbhn\") pod \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\" (UID: \"ccecd875-4b60-48ab-8f90-944cd4e6ed80\") "
Sep 20 01:13:54.258445 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.258421    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccecd875-4b60-48ab-8f90-944cd4e6ed80-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccecd875-4b60-48ab-8f90-944cd4e6ed80" (UID: "ccecd875-4b60-48ab-8f90-944cd4e6ed80"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:54.258573 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.258558    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccecd875-4b60-48ab-8f90-944cd4e6ed80-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.260113 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.260091    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccecd875-4b60-48ab-8f90-944cd4e6ed80" (UID: "ccecd875-4b60-48ab-8f90-944cd4e6ed80"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:13:54.260321 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.260299    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccecd875-4b60-48ab-8f90-944cd4e6ed80-kube-api-access-pxbhn" (OuterVolumeSpecName: "kube-api-access-pxbhn") pod "ccecd875-4b60-48ab-8f90-944cd4e6ed80" (UID: "ccecd875-4b60-48ab-8f90-944cd4e6ed80"). InnerVolumeSpecName "kube-api-access-pxbhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:54.260386 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.260366    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccecd875-4b60-48ab-8f90-944cd4e6ed80" (UID: "ccecd875-4b60-48ab-8f90-944cd4e6ed80"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:13:54.359112 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.359081    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.359112 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.359109    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccecd875-4b60-48ab-8f90-944cd4e6ed80-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.359112 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:54.359119    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxbhn\" (UniqueName: \"kubernetes.io/projected/ccecd875-4b60-48ab-8f90-944cd4e6ed80-kube-api-access-pxbhn\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:13:55.147287 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:55.147240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff" event={"ID":"ccecd875-4b60-48ab-8f90-944cd4e6ed80","Type":"ContainerDied","Data":"26a07dd66338f4830479f814a4e651066214bb3b3ece4189af34ec425c7fdd79"}
Sep 20 01:13:55.147287 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:55.147277    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"
Sep 20 01:13:55.147827 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:55.147322    2568 scope.go:117] "RemoveContainer" containerID="8d2cacd596c56e2ead0e845c9f2384cb0797ed8f4338b511eba8f8812b329ba7"
Sep 20 01:13:55.169149 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:55.169127    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"]
Sep 20 01:13:55.173220 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:55.173199    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bc4088-7d4f6979bc-mb9ff"]
Sep 20 01:13:55.988146 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:55.988110    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccecd875-4b60-48ab-8f90-944cd4e6ed80" path="/var/lib/kubelet/pods/ccecd875-4b60-48ab-8f90-944cd4e6ed80/volumes"
Sep 20 01:13:56.163250 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:56.163213    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"]
Sep 20 01:13:57.095438 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:57.095407    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"]
Sep 20 01:13:57.100191 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:13:57.100162    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"]
Sep 20 01:14:07.302700 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.302659    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"]
Sep 20 01:14:07.303657 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.303601    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" podUID="0d1a5243-69ab-44d1-a932-dee2f319c499" containerName="maas-api" containerID="cri-o://a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4" gracePeriod=30
Sep 20 01:14:07.564050 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.563974    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:14:07.689161 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.689129    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls\") pod \"0d1a5243-69ab-44d1-a932-dee2f319c499\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") "
Sep 20 01:14:07.689336 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.689201    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d1a5243-69ab-44d1-a932-dee2f319c499-openshift-service-ca\") pod \"0d1a5243-69ab-44d1-a932-dee2f319c499\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") "
Sep 20 01:14:07.689336 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.689254    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr2b9\" (UniqueName: \"kubernetes.io/projected/0d1a5243-69ab-44d1-a932-dee2f319c499-kube-api-access-lr2b9\") pod \"0d1a5243-69ab-44d1-a932-dee2f319c499\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") "
Sep 20 01:14:07.689411 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.689386    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-metrics-certs\") pod \"0d1a5243-69ab-44d1-a932-dee2f319c499\" (UID: \"0d1a5243-69ab-44d1-a932-dee2f319c499\") "
Sep 20 01:14:07.689639 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.689605    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d1a5243-69ab-44d1-a932-dee2f319c499-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d1a5243-69ab-44d1-a932-dee2f319c499" (UID: "0d1a5243-69ab-44d1-a932-dee2f319c499"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:07.689758 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.689730    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d1a5243-69ab-44d1-a932-dee2f319c499-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:07.691431 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.691403    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1a5243-69ab-44d1-a932-dee2f319c499-kube-api-access-lr2b9" (OuterVolumeSpecName: "kube-api-access-lr2b9") pod "0d1a5243-69ab-44d1-a932-dee2f319c499" (UID: "0d1a5243-69ab-44d1-a932-dee2f319c499"). InnerVolumeSpecName "kube-api-access-lr2b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:07.691521 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.691475    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d1a5243-69ab-44d1-a932-dee2f319c499" (UID: "0d1a5243-69ab-44d1-a932-dee2f319c499"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:07.691521 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.691493    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d1a5243-69ab-44d1-a932-dee2f319c499" (UID: "0d1a5243-69ab-44d1-a932-dee2f319c499"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:07.790649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.790615    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:07.790649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.790643    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d1a5243-69ab-44d1-a932-dee2f319c499-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:07.790649 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:07.790652    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr2b9\" (UniqueName: \"kubernetes.io/projected/0d1a5243-69ab-44d1-a932-dee2f319c499-kube-api-access-lr2b9\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:08.240822 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.240729    2568 generic.go:356] "Generic (PLEG): container finished" podID="0d1a5243-69ab-44d1-a932-dee2f319c499" containerID="a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4" exitCode=0
Sep 20 01:14:08.240822 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.240782    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"
Sep 20 01:14:08.240822 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.240805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" event={"ID":"0d1a5243-69ab-44d1-a932-dee2f319c499","Type":"ContainerDied","Data":"a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4"}
Sep 20 01:14:08.241141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.240871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp" event={"ID":"0d1a5243-69ab-44d1-a932-dee2f319c499","Type":"ContainerDied","Data":"7108fbaeff8c91d8841b970a17edab18424b411fdd39b4f619d044921911c57f"}
Sep 20 01:14:08.241141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.240901    2568 scope.go:117] "RemoveContainer" containerID="a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4"
Sep 20 01:14:08.252078 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.252037    2568 scope.go:117] "RemoveContainer" containerID="a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4"
Sep 20 01:14:08.252367 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:14:08.252347    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4\": container with ID starting with a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4 not found: ID does not exist" containerID="a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4"
Sep 20 01:14:08.252450 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.252377    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4"} err="failed to get container status \"a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4\": rpc error: code = NotFound desc = could not find container \"a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4\": container with ID starting with a03f54ca474633d50e02707cebb53ce179f75dbcb2a9ea947c131ff78360bcd4 not found: ID does not exist"
Sep 20 01:14:08.258108 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.258079    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"]
Sep 20 01:14:08.260815 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.260794    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-4e301e-78cd894897-x6kbp"]
Sep 20 01:14:08.550488 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.550388    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"]
Sep 20 01:14:08.551321 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.551286    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" podUID="bd95df85-8225-44e0-a9cf-3ba9984a88a8" containerName="maas-api" containerID="cri-o://e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861" gracePeriod=30
Sep 20 01:14:08.809182 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.809112    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:14:08.901443 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.901415    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-metrics-certs\") pod \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") "
Sep 20 01:14:08.901594 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.901461    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f788m\" (UniqueName: \"kubernetes.io/projected/bd95df85-8225-44e0-a9cf-3ba9984a88a8-kube-api-access-f788m\") pod \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") "
Sep 20 01:14:08.901594 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.901491    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd95df85-8225-44e0-a9cf-3ba9984a88a8-openshift-service-ca\") pod \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") "
Sep 20 01:14:08.901594 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.901536    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls\") pod \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\" (UID: \"bd95df85-8225-44e0-a9cf-3ba9984a88a8\") "
Sep 20 01:14:08.901883 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.901849    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd95df85-8225-44e0-a9cf-3ba9984a88a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd95df85-8225-44e0-a9cf-3ba9984a88a8" (UID: "bd95df85-8225-44e0-a9cf-3ba9984a88a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:08.903717 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.903683    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd95df85-8225-44e0-a9cf-3ba9984a88a8-kube-api-access-f788m" (OuterVolumeSpecName: "kube-api-access-f788m") pod "bd95df85-8225-44e0-a9cf-3ba9984a88a8" (UID: "bd95df85-8225-44e0-a9cf-3ba9984a88a8"). InnerVolumeSpecName "kube-api-access-f788m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:08.903855 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.903714    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd95df85-8225-44e0-a9cf-3ba9984a88a8" (UID: "bd95df85-8225-44e0-a9cf-3ba9984a88a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:08.903855 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:08.903734    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bd95df85-8225-44e0-a9cf-3ba9984a88a8" (UID: "bd95df85-8225-44e0-a9cf-3ba9984a88a8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:09.002936 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.002873    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.002936 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.002903    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f788m\" (UniqueName: \"kubernetes.io/projected/bd95df85-8225-44e0-a9cf-3ba9984a88a8-kube-api-access-f788m\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.002936 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.002942    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd95df85-8225-44e0-a9cf-3ba9984a88a8-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.003254 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.002956    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd95df85-8225-44e0-a9cf-3ba9984a88a8-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.249397 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.249353    2568 generic.go:356] "Generic (PLEG): container finished" podID="bd95df85-8225-44e0-a9cf-3ba9984a88a8" containerID="e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861" exitCode=0
Sep 20 01:14:09.249397 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.249403    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"
Sep 20 01:14:09.249666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.249445    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" event={"ID":"bd95df85-8225-44e0-a9cf-3ba9984a88a8","Type":"ContainerDied","Data":"e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861"}
Sep 20 01:14:09.249666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.249501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n" event={"ID":"bd95df85-8225-44e0-a9cf-3ba9984a88a8","Type":"ContainerDied","Data":"8bacdeb261a5d9ebb1128e990278b3ce1d3b19ad188966558a58711372052112"}
Sep 20 01:14:09.249666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.249531    2568 scope.go:117] "RemoveContainer" containerID="e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861"
Sep 20 01:14:09.260511 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.260488    2568 scope.go:117] "RemoveContainer" containerID="e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861"
Sep 20 01:14:09.260774 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:14:09.260753    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861\": container with ID starting with e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861 not found: ID does not exist" containerID="e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861"
Sep 20 01:14:09.260826 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.260782    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861"} err="failed to get container status \"e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861\": rpc error: code = NotFound desc = could not find container \"e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861\": container with ID starting with e1ec1c1c742f16883f396f1e8cfa86e129fcba71de82ab8e03ab80ee5d508861 not found: ID does not exist"
Sep 20 01:14:09.271279 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.271255    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"]
Sep 20 01:14:09.275012 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.274989    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e2e8bc-7889b87ffb-ss27n"]
Sep 20 01:14:09.988825 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.988794    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d1a5243-69ab-44d1-a932-dee2f319c499" path="/var/lib/kubelet/pods/0d1a5243-69ab-44d1-a932-dee2f319c499/volumes"
Sep 20 01:14:09.989229 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:09.989215    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd95df85-8225-44e0-a9cf-3ba9984a88a8" path="/var/lib/kubelet/pods/bd95df85-8225-44e0-a9cf-3ba9984a88a8/volumes"
Sep 20 01:14:11.183824 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.183760    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz" podUID="629910ed-550d-43f1-abf8-bcd8add6afa6" containerName="main" containerID="cri-o://fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0" gracePeriod=45
Sep 20 01:14:11.451879 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.451812    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:14:11.630051 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630020    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrsnv\" (UniqueName: \"kubernetes.io/projected/629910ed-550d-43f1-abf8-bcd8add6afa6-kube-api-access-qrsnv\") pod \"629910ed-550d-43f1-abf8-bcd8add6afa6\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") "
Sep 20 01:14:11.630227 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630083    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-dshm\") pod \"629910ed-550d-43f1-abf8-bcd8add6afa6\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") "
Sep 20 01:14:11.630227 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630167    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-tmp-dir\") pod \"629910ed-550d-43f1-abf8-bcd8add6afa6\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") "
Sep 20 01:14:11.630227 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630194    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-model-cache\") pod \"629910ed-550d-43f1-abf8-bcd8add6afa6\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") "
Sep 20 01:14:11.630227 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630218    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629910ed-550d-43f1-abf8-bcd8add6afa6-tls-certs\") pod \"629910ed-550d-43f1-abf8-bcd8add6afa6\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") "
Sep 20 01:14:11.630454 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630238    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-home\") pod \"629910ed-550d-43f1-abf8-bcd8add6afa6\" (UID: \"629910ed-550d-43f1-abf8-bcd8add6afa6\") "
Sep 20 01:14:11.630454 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630437    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "629910ed-550d-43f1-abf8-bcd8add6afa6" (UID: "629910ed-550d-43f1-abf8-bcd8add6afa6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.630549 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630453    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-model-cache" (OuterVolumeSpecName: "model-cache") pod "629910ed-550d-43f1-abf8-bcd8add6afa6" (UID: "629910ed-550d-43f1-abf8-bcd8add6afa6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.630609 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630590    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-tmp-dir\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.630653 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630615    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-home" (OuterVolumeSpecName: "home") pod "629910ed-550d-43f1-abf8-bcd8add6afa6" (UID: "629910ed-550d-43f1-abf8-bcd8add6afa6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.630653 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.630609    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-model-cache\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.632353 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.632325    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/629910ed-550d-43f1-abf8-bcd8add6afa6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "629910ed-550d-43f1-abf8-bcd8add6afa6" (UID: "629910ed-550d-43f1-abf8-bcd8add6afa6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:11.632460 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.632380    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629910ed-550d-43f1-abf8-bcd8add6afa6-kube-api-access-qrsnv" (OuterVolumeSpecName: "kube-api-access-qrsnv") pod "629910ed-550d-43f1-abf8-bcd8add6afa6" (UID: "629910ed-550d-43f1-abf8-bcd8add6afa6"). InnerVolumeSpecName "kube-api-access-qrsnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:11.632460 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.632425    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-dshm" (OuterVolumeSpecName: "dshm") pod "629910ed-550d-43f1-abf8-bcd8add6afa6" (UID: "629910ed-550d-43f1-abf8-bcd8add6afa6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.731583 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.731445    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629910ed-550d-43f1-abf8-bcd8add6afa6-tls-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.731583 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.731484    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-home\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.731583 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.731497    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrsnv\" (UniqueName: \"kubernetes.io/projected/629910ed-550d-43f1-abf8-bcd8add6afa6-kube-api-access-qrsnv\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.731583 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:11.731509    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629910ed-550d-43f1-abf8-bcd8add6afa6-dshm\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.115940 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.115884    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb" podUID="c6514e24-f3a1-4d1d-8664-1017d0844902" containerName="main" containerID="cri-o://42f0245672fb88a7d9eb38c1c77d17e77b1e3d6f0f1bfa38665d7aec4a8c68b5" gracePeriod=45
Sep 20 01:14:12.119597 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.119565    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd" podUID="3586680a-59b3-45c1-bef6-2951237adefa" containerName="main" containerID="cri-o://c0a1e910f48124911586a1df2ddbc48c2740f5c613fdd96fff16995a54e27332" gracePeriod=45
Sep 20 01:14:12.274006 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.273903    2568 generic.go:356] "Generic (PLEG): container finished" podID="c6514e24-f3a1-4d1d-8664-1017d0844902" containerID="42f0245672fb88a7d9eb38c1c77d17e77b1e3d6f0f1bfa38665d7aec4a8c68b5" exitCode=0
Sep 20 01:14:12.274006 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.273946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb" event={"ID":"c6514e24-f3a1-4d1d-8664-1017d0844902","Type":"ContainerDied","Data":"42f0245672fb88a7d9eb38c1c77d17e77b1e3d6f0f1bfa38665d7aec4a8c68b5"}
Sep 20 01:14:12.275217 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.275198    2568 generic.go:356] "Generic (PLEG): container finished" podID="629910ed-550d-43f1-abf8-bcd8add6afa6" containerID="fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0" exitCode=0
Sep 20 01:14:12.275359 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.275344    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz" event={"ID":"629910ed-550d-43f1-abf8-bcd8add6afa6","Type":"ContainerDied","Data":"fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0"}
Sep 20 01:14:12.275419 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.275372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz" event={"ID":"629910ed-550d-43f1-abf8-bcd8add6afa6","Type":"ContainerDied","Data":"3be1cd4f00eda1dc103d5fb4f6afe2b6ef2a02997859b8a6c8b8b6880f918b02"}
Sep 20 01:14:12.275419 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.275394    2568 scope.go:117] "RemoveContainer" containerID="fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0"
Sep 20 01:14:12.275499 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.275489    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"
Sep 20 01:14:12.277836 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.277805    2568 generic.go:356] "Generic (PLEG): container finished" podID="3586680a-59b3-45c1-bef6-2951237adefa" containerID="c0a1e910f48124911586a1df2ddbc48c2740f5c613fdd96fff16995a54e27332" exitCode=0
Sep 20 01:14:12.277990 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.277852    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd" event={"ID":"3586680a-59b3-45c1-bef6-2951237adefa","Type":"ContainerDied","Data":"c0a1e910f48124911586a1df2ddbc48c2740f5c613fdd96fff16995a54e27332"}
Sep 20 01:14:12.287462 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.287362    2568 scope.go:117] "RemoveContainer" containerID="fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0"
Sep 20 01:14:12.287704 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:14:12.287675    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0\": container with ID starting with fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0 not found: ID does not exist" containerID="fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0"
Sep 20 01:14:12.287781 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.287715    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0"} err="failed to get container status \"fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0\": rpc error: code = NotFound desc = could not find container \"fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0\": container with ID starting with fafc15494919cda349012b499a8356c87df379636cbf106fa95f44d4a8546ca0 not found: ID does not exist"
Sep 20 01:14:12.294860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.294672    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"]
Sep 20 01:14:12.297893 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.297872    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/premium-w4-4e301e-kserve-69b57b5cdb-755qz"]
Sep 20 01:14:12.414443 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.414417    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:14:12.416394 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.416375    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:14:12.539675 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.539602    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-dshm\") pod \"3586680a-59b3-45c1-bef6-2951237adefa\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") "
Sep 20 01:14:12.539675 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.539656    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-tmp-dir\") pod \"3586680a-59b3-45c1-bef6-2951237adefa\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") "
Sep 20 01:14:12.539896 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.539689    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vnbr\" (UniqueName: \"kubernetes.io/projected/c6514e24-f3a1-4d1d-8664-1017d0844902-kube-api-access-8vnbr\") pod \"c6514e24-f3a1-4d1d-8664-1017d0844902\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") "
Sep 20 01:14:12.539896 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.539723    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-dshm\") pod \"c6514e24-f3a1-4d1d-8664-1017d0844902\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") "
Sep 20 01:14:12.539896 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.539753    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3586680a-59b3-45c1-bef6-2951237adefa-tls-certs\") pod \"3586680a-59b3-45c1-bef6-2951237adefa\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") "
Sep 20 01:14:12.540103 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.539944    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3586680a-59b3-45c1-bef6-2951237adefa" (UID: "3586680a-59b3-45c1-bef6-2951237adefa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.540169 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540154    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-home\") pod \"3586680a-59b3-45c1-bef6-2951237adefa\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") "
Sep 20 01:14:12.540250 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540218    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-model-cache\") pod \"c6514e24-f3a1-4d1d-8664-1017d0844902\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") "
Sep 20 01:14:12.540323 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540253    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6514e24-f3a1-4d1d-8664-1017d0844902-tls-certs\") pod \"c6514e24-f3a1-4d1d-8664-1017d0844902\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") "
Sep 20 01:14:12.540323 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-tmp-dir\") pod \"c6514e24-f3a1-4d1d-8664-1017d0844902\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") "
Sep 20 01:14:12.540440 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540335    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw5fp\" (UniqueName: \"kubernetes.io/projected/3586680a-59b3-45c1-bef6-2951237adefa-kube-api-access-tw5fp\") pod \"3586680a-59b3-45c1-bef6-2951237adefa\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") "
Sep 20 01:14:12.540440 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540360    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-model-cache\") pod \"3586680a-59b3-45c1-bef6-2951237adefa\" (UID: \"3586680a-59b3-45c1-bef6-2951237adefa\") "
Sep 20 01:14:12.540440 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540388    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-home\") pod \"c6514e24-f3a1-4d1d-8664-1017d0844902\" (UID: \"c6514e24-f3a1-4d1d-8664-1017d0844902\") "
Sep 20 01:14:12.541574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.540709    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-tmp-dir\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.541574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.541018    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-home" (OuterVolumeSpecName: "home") pod "c6514e24-f3a1-4d1d-8664-1017d0844902" (UID: "c6514e24-f3a1-4d1d-8664-1017d0844902"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.541574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.541197    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-home" (OuterVolumeSpecName: "home") pod "3586680a-59b3-45c1-bef6-2951237adefa" (UID: "3586680a-59b3-45c1-bef6-2951237adefa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.541574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.541352    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6514e24-f3a1-4d1d-8664-1017d0844902" (UID: "c6514e24-f3a1-4d1d-8664-1017d0844902"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.542430 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.542183    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6514e24-f3a1-4d1d-8664-1017d0844902" (UID: "c6514e24-f3a1-4d1d-8664-1017d0844902"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.542561 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.542459    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-model-cache" (OuterVolumeSpecName: "model-cache") pod "3586680a-59b3-45c1-bef6-2951237adefa" (UID: "3586680a-59b3-45c1-bef6-2951237adefa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.543379 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.543344    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6514e24-f3a1-4d1d-8664-1017d0844902-kube-api-access-8vnbr" (OuterVolumeSpecName: "kube-api-access-8vnbr") pod "c6514e24-f3a1-4d1d-8664-1017d0844902" (UID: "c6514e24-f3a1-4d1d-8664-1017d0844902"). InnerVolumeSpecName "kube-api-access-8vnbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:12.544306 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.544280    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6514e24-f3a1-4d1d-8664-1017d0844902-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6514e24-f3a1-4d1d-8664-1017d0844902" (UID: "c6514e24-f3a1-4d1d-8664-1017d0844902"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:12.544306 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.544298    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-dshm" (OuterVolumeSpecName: "dshm") pod "c6514e24-f3a1-4d1d-8664-1017d0844902" (UID: "c6514e24-f3a1-4d1d-8664-1017d0844902"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.544306 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.544290    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3586680a-59b3-45c1-bef6-2951237adefa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3586680a-59b3-45c1-bef6-2951237adefa" (UID: "3586680a-59b3-45c1-bef6-2951237adefa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:12.544525 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.544329    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-dshm" (OuterVolumeSpecName: "dshm") pod "3586680a-59b3-45c1-bef6-2951237adefa" (UID: "3586680a-59b3-45c1-bef6-2951237adefa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.546156 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.546129    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3586680a-59b3-45c1-bef6-2951237adefa-kube-api-access-tw5fp" (OuterVolumeSpecName: "kube-api-access-tw5fp") pod "3586680a-59b3-45c1-bef6-2951237adefa" (UID: "3586680a-59b3-45c1-bef6-2951237adefa"). InnerVolumeSpecName "kube-api-access-tw5fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:12.641405 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641370    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vnbr\" (UniqueName: \"kubernetes.io/projected/c6514e24-f3a1-4d1d-8664-1017d0844902-kube-api-access-8vnbr\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641405 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641402    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-dshm\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641405 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641413    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3586680a-59b3-45c1-bef6-2951237adefa-tls-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641421    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-home\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641430    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-model-cache\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641443    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6514e24-f3a1-4d1d-8664-1017d0844902-tls-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641451    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-tmp-dir\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641459    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw5fp\" (UniqueName: \"kubernetes.io/projected/3586680a-59b3-45c1-bef6-2951237adefa-kube-api-access-tw5fp\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641465    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-model-cache\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641473    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6514e24-f3a1-4d1d-8664-1017d0844902-home\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.641728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.641480    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3586680a-59b3-45c1-bef6-2951237adefa-dshm\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.906695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.906608    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"]
Sep 20 01:14:12.906897 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:12.906871    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2" podUID="11ec0dda-95ec-4577-9b7e-4162158fd8c7" containerName="maas-api" containerID="cri-o://f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378" gracePeriod=30
Sep 20 01:14:13.156976 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.156888    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:14:13.248201 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.248162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-metrics-certs\") pod \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") "
Sep 20 01:14:13.248375 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.248219    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd7wb\" (UniqueName: \"kubernetes.io/projected/11ec0dda-95ec-4577-9b7e-4162158fd8c7-kube-api-access-zd7wb\") pod \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") "
Sep 20 01:14:13.248375 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.248286    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-maas-api-tls\") pod \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") "
Sep 20 01:14:13.248375 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.248321    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ec0dda-95ec-4577-9b7e-4162158fd8c7-openshift-service-ca\") pod \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\" (UID: \"11ec0dda-95ec-4577-9b7e-4162158fd8c7\") "
Sep 20 01:14:13.248867 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.248826    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ec0dda-95ec-4577-9b7e-4162158fd8c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11ec0dda-95ec-4577-9b7e-4162158fd8c7" (UID: "11ec0dda-95ec-4577-9b7e-4162158fd8c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:13.250613 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.250578    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ec0dda-95ec-4577-9b7e-4162158fd8c7-kube-api-access-zd7wb" (OuterVolumeSpecName: "kube-api-access-zd7wb") pod "11ec0dda-95ec-4577-9b7e-4162158fd8c7" (UID: "11ec0dda-95ec-4577-9b7e-4162158fd8c7"). InnerVolumeSpecName "kube-api-access-zd7wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:13.250788 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.250765    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11ec0dda-95ec-4577-9b7e-4162158fd8c7" (UID: "11ec0dda-95ec-4577-9b7e-4162158fd8c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:13.250895 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.250849    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "11ec0dda-95ec-4577-9b7e-4162158fd8c7" (UID: "11ec0dda-95ec-4577-9b7e-4162158fd8c7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:13.286865 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.286829    2568 generic.go:356] "Generic (PLEG): container finished" podID="11ec0dda-95ec-4577-9b7e-4162158fd8c7" containerID="f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378" exitCode=0
Sep 20 01:14:13.287281 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.286881    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"
Sep 20 01:14:13.287281 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.286938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2" event={"ID":"11ec0dda-95ec-4577-9b7e-4162158fd8c7","Type":"ContainerDied","Data":"f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378"}
Sep 20 01:14:13.287281 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.287008    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2" event={"ID":"11ec0dda-95ec-4577-9b7e-4162158fd8c7","Type":"ContainerDied","Data":"4a222055ee60599d052c29c8fc10a86819e7d2d9ffc8151e13b212c493708dda"}
Sep 20 01:14:13.287281 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.287039    2568 scope.go:117] "RemoveContainer" containerID="f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378"
Sep 20 01:14:13.288753 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.288738    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"
Sep 20 01:14:13.288860 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.288787    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd" event={"ID":"3586680a-59b3-45c1-bef6-2951237adefa","Type":"ContainerDied","Data":"9374163ed287fad38b18cb1ca4900c4918b7dd2f7979504d133136ec694b2a46"}
Sep 20 01:14:13.290572 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.290550    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"
Sep 20 01:14:13.290676 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.290587    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb" event={"ID":"c6514e24-f3a1-4d1d-8664-1017d0844902","Type":"ContainerDied","Data":"67596fab6acdf5116c3165e40428c43655f29041b9e9360376904ea938570a65"}
Sep 20 01:14:13.300487 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.300329    2568 scope.go:117] "RemoveContainer" containerID="f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378"
Sep 20 01:14:13.300665 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:14:13.300636    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378\": container with ID starting with f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378 not found: ID does not exist" containerID="f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378"
Sep 20 01:14:13.300741 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.300671    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378"} err="failed to get container status \"f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378\": rpc error: code = NotFound desc = could not find container \"f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378\": container with ID starting with f5c165d77186880bc4bc5e5d7b911867e9a6ce0073e050b61295269d751c2378 not found: ID does not exist"
Sep 20 01:14:13.300741 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.300722    2568 scope.go:117] "RemoveContainer" containerID="c0a1e910f48124911586a1df2ddbc48c2740f5c613fdd96fff16995a54e27332"
Sep 20 01:14:13.310487 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.310467    2568 scope.go:117] "RemoveContainer" containerID="42f0245672fb88a7d9eb38c1c77d17e77b1e3d6f0f1bfa38665d7aec4a8c68b5"
Sep 20 01:14:13.312351 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.312334    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"]
Sep 20 01:14:13.315082 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.315058    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-0766ea-864dc7454c-pfgh2"]
Sep 20 01:14:13.322740 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.322720    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"]
Sep 20 01:14:13.325095 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.325076    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-2-w0-e2e8bc-kserve-5df587bf5c-tdlhb"]
Sep 20 01:14:13.333090 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.333070    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"]
Sep 20 01:14:13.338812 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.338792    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/distinct-w0-e2e8bc-kserve-7ccf79c75d-8kdsd"]
Sep 20 01:14:13.350027 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.349996    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.350027 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.350022    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd7wb\" (UniqueName: \"kubernetes.io/projected/11ec0dda-95ec-4577-9b7e-4162158fd8c7-kube-api-access-zd7wb\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.350284 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.350036    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ec0dda-95ec-4577-9b7e-4162158fd8c7-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.350284 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.350049    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ec0dda-95ec-4577-9b7e-4162158fd8c7-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.988973 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.988936    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11ec0dda-95ec-4577-9b7e-4162158fd8c7" path="/var/lib/kubelet/pods/11ec0dda-95ec-4577-9b7e-4162158fd8c7/volumes"
Sep 20 01:14:13.989376 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.989362    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3586680a-59b3-45c1-bef6-2951237adefa" path="/var/lib/kubelet/pods/3586680a-59b3-45c1-bef6-2951237adefa/volumes"
Sep 20 01:14:13.989773 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.989760    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629910ed-550d-43f1-abf8-bcd8add6afa6" path="/var/lib/kubelet/pods/629910ed-550d-43f1-abf8-bcd8add6afa6/volumes"
Sep 20 01:14:13.990494 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:13.990473    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6514e24-f3a1-4d1d-8664-1017d0844902" path="/var/lib/kubelet/pods/c6514e24-f3a1-4d1d-8664-1017d0844902/volumes"
Sep 20 01:14:30.342468 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.342429    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"]
Sep 20 01:14:30.342946 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.342705    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" podUID="ac985075-e30d-4aa1-88af-d68939bcaf19" containerName="maas-api" containerID="cri-o://26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8" gracePeriod=30
Sep 20 01:14:30.625105 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.625066    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:14:30.714719 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.714686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac985075-e30d-4aa1-88af-d68939bcaf19-openshift-service-ca\") pod \"ac985075-e30d-4aa1-88af-d68939bcaf19\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") "
Sep 20 01:14:30.714896 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.714766    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-metrics-certs\") pod \"ac985075-e30d-4aa1-88af-d68939bcaf19\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") "
Sep 20 01:14:30.714896 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.714809    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls\") pod \"ac985075-e30d-4aa1-88af-d68939bcaf19\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") "
Sep 20 01:14:30.715003 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.714968    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c68fm\" (UniqueName: \"kubernetes.io/projected/ac985075-e30d-4aa1-88af-d68939bcaf19-kube-api-access-c68fm\") pod \"ac985075-e30d-4aa1-88af-d68939bcaf19\" (UID: \"ac985075-e30d-4aa1-88af-d68939bcaf19\") "
Sep 20 01:14:30.715152 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.715124    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac985075-e30d-4aa1-88af-d68939bcaf19-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac985075-e30d-4aa1-88af-d68939bcaf19" (UID: "ac985075-e30d-4aa1-88af-d68939bcaf19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:30.715351 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.715334    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac985075-e30d-4aa1-88af-d68939bcaf19-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:30.717050 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.717013    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac985075-e30d-4aa1-88af-d68939bcaf19" (UID: "ac985075-e30d-4aa1-88af-d68939bcaf19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:30.717050 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.717020    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac985075-e30d-4aa1-88af-d68939bcaf19-kube-api-access-c68fm" (OuterVolumeSpecName: "kube-api-access-c68fm") pod "ac985075-e30d-4aa1-88af-d68939bcaf19" (UID: "ac985075-e30d-4aa1-88af-d68939bcaf19"). InnerVolumeSpecName "kube-api-access-c68fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:30.717204 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.717025    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ac985075-e30d-4aa1-88af-d68939bcaf19" (UID: "ac985075-e30d-4aa1-88af-d68939bcaf19"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:30.816821 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.816781    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:30.816821 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.816813    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c68fm\" (UniqueName: \"kubernetes.io/projected/ac985075-e30d-4aa1-88af-d68939bcaf19-kube-api-access-c68fm\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:30.816821 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:30.816824    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac985075-e30d-4aa1-88af-d68939bcaf19-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:14:31.410795 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.410762    2568 generic.go:356] "Generic (PLEG): container finished" podID="ac985075-e30d-4aa1-88af-d68939bcaf19" containerID="26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8" exitCode=0
Sep 20 01:14:31.411274 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.410801    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"
Sep 20 01:14:31.411274 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.410851    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" event={"ID":"ac985075-e30d-4aa1-88af-d68939bcaf19","Type":"ContainerDied","Data":"26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8"}
Sep 20 01:14:31.411274 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.410900    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9" event={"ID":"ac985075-e30d-4aa1-88af-d68939bcaf19","Type":"ContainerDied","Data":"eb7ee8bc8af6f86370eb787a686c94bad39e09825134e4d49b3a1cb0a9bcd850"}
Sep 20 01:14:31.411274 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.410952    2568 scope.go:117] "RemoveContainer" containerID="26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8"
Sep 20 01:14:31.421080 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.421061    2568 scope.go:117] "RemoveContainer" containerID="26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8"
Sep 20 01:14:31.421379 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:14:31.421361    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8\": container with ID starting with 26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8 not found: ID does not exist" containerID="26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8"
Sep 20 01:14:31.421429 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.421387    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8"} err="failed to get container status \"26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8\": rpc error: code = NotFound desc = could not find container \"26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8\": container with ID starting with 26ba352933bcbdd2c1e3c899761f56900d502c0bc6ea868c03131c388b925fe8 not found: ID does not exist"
Sep 20 01:14:31.434101 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.434066    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"]
Sep 20 01:14:31.437859 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.437833    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b8cbf1-855dbdbb99-rrpj9"]
Sep 20 01:14:31.987237 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:14:31.987204    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac985075-e30d-4aa1-88af-d68939bcaf19" path="/var/lib/kubelet/pods/ac985075-e30d-4aa1-88af-d68939bcaf19/volumes"
Sep 20 01:15:08.822687 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.822646    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7608-144ce0"]
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823053    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ec0dda-95ec-4577-9b7e-4162158fd8c7" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823067    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ec0dda-95ec-4577-9b7e-4162158fd8c7" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823078    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd95df85-8225-44e0-a9cf-3ba9984a88a8" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823083    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd95df85-8225-44e0-a9cf-3ba9984a88a8" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823090    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccecd875-4b60-48ab-8f90-944cd4e6ed80" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823096    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccecd875-4b60-48ab-8f90-944cd4e6ed80" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823106    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3586680a-59b3-45c1-bef6-2951237adefa" containerName="main"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823111    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3586680a-59b3-45c1-bef6-2951237adefa" containerName="main"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823119    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6514e24-f3a1-4d1d-8664-1017d0844902" containerName="main"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823124    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6514e24-f3a1-4d1d-8664-1017d0844902" containerName="main"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823131    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d1a5243-69ab-44d1-a932-dee2f319c499" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823136    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d1a5243-69ab-44d1-a932-dee2f319c499" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823141    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629910ed-550d-43f1-abf8-bcd8add6afa6" containerName="main"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823146    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="629910ed-550d-43f1-abf8-bcd8add6afa6" containerName="main"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823163    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac985075-e30d-4aa1-88af-d68939bcaf19" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823168    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac985075-e30d-4aa1-88af-d68939bcaf19" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823174    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf86854-546f-4d23-84f8-31c7ddda20e9" containerName="maas-api"
Sep 20 01:15:08.823187 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823181    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf86854-546f-4d23-84f8-31c7ddda20e9" containerName="maas-api"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823235    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6514e24-f3a1-4d1d-8664-1017d0844902" containerName="main"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823244    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf86854-546f-4d23-84f8-31c7ddda20e9" containerName="maas-api"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823250    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3586680a-59b3-45c1-bef6-2951237adefa" containerName="main"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823255    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d1a5243-69ab-44d1-a932-dee2f319c499" containerName="maas-api"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823261    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="629910ed-550d-43f1-abf8-bcd8add6afa6" containerName="main"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823267    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccecd875-4b60-48ab-8f90-944cd4e6ed80" containerName="maas-api"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823273    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac985075-e30d-4aa1-88af-d68939bcaf19" containerName="maas-api"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823279    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11ec0dda-95ec-4577-9b7e-4162158fd8c7" containerName="maas-api"
Sep 20 01:15:08.823728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.823285    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd95df85-8225-44e0-a9cf-3ba9984a88a8" containerName="maas-api"
Sep 20 01:15:08.826393 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.826372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:08.828511 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.828484    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6z9kv\""
Sep 20 01:15:08.831894 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.831864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7608-144ce0"]
Sep 20 01:15:08.874865 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.874833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prrnh\" (UniqueName: \"kubernetes.io/projected/f853e06b-71d4-41b6-b23d-80cffa31f88f-kube-api-access-prrnh\") pod \"test-curl-7608-144ce0\" (UID: \"f853e06b-71d4-41b6-b23d-80cffa31f88f\") " pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:08.976220 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.976185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prrnh\" (UniqueName: \"kubernetes.io/projected/f853e06b-71d4-41b6-b23d-80cffa31f88f-kube-api-access-prrnh\") pod \"test-curl-7608-144ce0\" (UID: \"f853e06b-71d4-41b6-b23d-80cffa31f88f\") " pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:08.984186 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:08.984160    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prrnh\" (UniqueName: \"kubernetes.io/projected/f853e06b-71d4-41b6-b23d-80cffa31f88f-kube-api-access-prrnh\") pod \"test-curl-7608-144ce0\" (UID: \"f853e06b-71d4-41b6-b23d-80cffa31f88f\") " pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:09.138067 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:09.137980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:09.407363 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:09.407336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7608-144ce0"]
Sep 20 01:15:09.408784 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:15:09.408753    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf853e06b_71d4_41b6_b23d_80cffa31f88f.slice/crio-12fecffed42f1a821cb89e9bbbcad2aaf24569dcf069f7b0699d6c3f33ed16c2 WatchSource:0}: Error finding container 12fecffed42f1a821cb89e9bbbcad2aaf24569dcf069f7b0699d6c3f33ed16c2: Status 404 returned error can't find the container with id 12fecffed42f1a821cb89e9bbbcad2aaf24569dcf069f7b0699d6c3f33ed16c2
Sep 20 01:15:09.639376 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:09.639339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7608-144ce0" event={"ID":"f853e06b-71d4-41b6-b23d-80cffa31f88f","Type":"ContainerStarted","Data":"48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1"}
Sep 20 01:15:09.639376 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:09.639383    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7608-144ce0" event={"ID":"f853e06b-71d4-41b6-b23d-80cffa31f88f","Type":"ContainerStarted","Data":"12fecffed42f1a821cb89e9bbbcad2aaf24569dcf069f7b0699d6c3f33ed16c2"}
Sep 20 01:15:09.653182 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:09.653125    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7608-144ce0" podStartSLOduration=1.6531033160000002 podStartE2EDuration="1.653103316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:15:09.651859236 +0000 UTC m=+1665.901361040" watchObservedRunningTime="2026-09-20 01:15:09.653103316 +0000 UTC m=+1665.902605121"
Sep 20 01:15:10.252444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:10.252402    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7608-144ce0"]
Sep 20 01:15:10.256171 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:10.256137    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7608-144ce0"]
Sep 20 01:15:10.646110 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:15:10.646019    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7608-144ce0" container="test-curl-7608-144ce0"
Sep 20 01:15:11.651583 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:11.651546    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7608-144ce0" podUID="f853e06b-71d4-41b6-b23d-80cffa31f88f" containerName="test-curl-7608-144ce0" containerID="cri-o://48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1" gracePeriod=2
Sep 20 01:15:11.653492 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:15:11.653462    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7608-144ce0\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="f853e06b-71d4-41b6-b23d-80cffa31f88f" pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:13.824855 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:13.824830    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:13.920361 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:13.920328    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prrnh\" (UniqueName: \"kubernetes.io/projected/f853e06b-71d4-41b6-b23d-80cffa31f88f-kube-api-access-prrnh\") pod \"f853e06b-71d4-41b6-b23d-80cffa31f88f\" (UID: \"f853e06b-71d4-41b6-b23d-80cffa31f88f\") "
Sep 20 01:15:13.922418 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:13.922392    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f853e06b-71d4-41b6-b23d-80cffa31f88f-kube-api-access-prrnh" (OuterVolumeSpecName: "kube-api-access-prrnh") pod "f853e06b-71d4-41b6-b23d-80cffa31f88f" (UID: "f853e06b-71d4-41b6-b23d-80cffa31f88f"). InnerVolumeSpecName "kube-api-access-prrnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:15:13.988228 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:13.988196    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f853e06b-71d4-41b6-b23d-80cffa31f88f" path="/var/lib/kubelet/pods/f853e06b-71d4-41b6-b23d-80cffa31f88f/volumes"
Sep 20 01:15:14.021573 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:14.021535    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prrnh\" (UniqueName: \"kubernetes.io/projected/f853e06b-71d4-41b6-b23d-80cffa31f88f-kube-api-access-prrnh\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:15:14.669333 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:14.669302    2568 generic.go:356] "Generic (PLEG): container finished" podID="f853e06b-71d4-41b6-b23d-80cffa31f88f" containerID="48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1" exitCode=137
Sep 20 01:15:14.669522 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:14.669341    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-144ce0"
Sep 20 01:15:14.669522 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:14.669404    2568 scope.go:117] "RemoveContainer" containerID="48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1"
Sep 20 01:15:14.678274 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:14.678257    2568 scope.go:117] "RemoveContainer" containerID="48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1"
Sep 20 01:15:14.678550 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:15:14.678528    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1\": container with ID starting with 48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1 not found: ID does not exist" containerID="48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1"
Sep 20 01:15:14.678656 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:15:14.678555    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1"} err="failed to get container status \"48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1\": rpc error: code = NotFound desc = could not find container \"48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1\": container with ID starting with 48c1c7a3a1c840952e284300a4b5a8d5c3fda63a3f83103e438d4d2d2e4025a1 not found: ID does not exist"
Sep 20 01:16:32.606947 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.606873    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7608-0753cd"]
Sep 20 01:16:32.607538 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.607510    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f853e06b-71d4-41b6-b23d-80cffa31f88f" containerName="test-curl-7608-144ce0"
Sep 20 01:16:32.607538 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.607533    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f853e06b-71d4-41b6-b23d-80cffa31f88f" containerName="test-curl-7608-144ce0"
Sep 20 01:16:32.607664 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.607624    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f853e06b-71d4-41b6-b23d-80cffa31f88f" containerName="test-curl-7608-144ce0"
Sep 20 01:16:32.610791 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.610762    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:32.612857 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.612832    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6z9kv\""
Sep 20 01:16:32.614361 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.614337    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7608-0753cd"]
Sep 20 01:16:32.637120 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.637061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdgrw\" (UniqueName: \"kubernetes.io/projected/3cbe4e52-e058-41fe-b8bf-9752ed12d22e-kube-api-access-cdgrw\") pod \"test-curl-7608-0753cd\" (UID: \"3cbe4e52-e058-41fe-b8bf-9752ed12d22e\") " pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:32.738045 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.738009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgrw\" (UniqueName: \"kubernetes.io/projected/3cbe4e52-e058-41fe-b8bf-9752ed12d22e-kube-api-access-cdgrw\") pod \"test-curl-7608-0753cd\" (UID: \"3cbe4e52-e058-41fe-b8bf-9752ed12d22e\") " pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:32.745328 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.745296    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdgrw\" (UniqueName: \"kubernetes.io/projected/3cbe4e52-e058-41fe-b8bf-9752ed12d22e-kube-api-access-cdgrw\") pod \"test-curl-7608-0753cd\" (UID: \"3cbe4e52-e058-41fe-b8bf-9752ed12d22e\") " pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:32.921394 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:32.921367    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:33.195639 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:33.195616    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7608-0753cd"]
Sep 20 01:16:33.197319 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:16:33.197287    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cbe4e52_e058_41fe_b8bf_9752ed12d22e.slice/crio-7e7b221b5ecf41f230bb55c0d188bab94b510ba509aae14d1db8c6cf0099c515 WatchSource:0}: Error finding container 7e7b221b5ecf41f230bb55c0d188bab94b510ba509aae14d1db8c6cf0099c515: Status 404 returned error can't find the container with id 7e7b221b5ecf41f230bb55c0d188bab94b510ba509aae14d1db8c6cf0099c515
Sep 20 01:16:34.125383 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.125347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7608-0753cd" event={"ID":"3cbe4e52-e058-41fe-b8bf-9752ed12d22e","Type":"ContainerStarted","Data":"708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c"}
Sep 20 01:16:34.125383 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.125391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7608-0753cd" event={"ID":"3cbe4e52-e058-41fe-b8bf-9752ed12d22e","Type":"ContainerStarted","Data":"7e7b221b5ecf41f230bb55c0d188bab94b510ba509aae14d1db8c6cf0099c515"}
Sep 20 01:16:34.139060 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.139009    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7608-0753cd" podStartSLOduration=2.138993916 podStartE2EDuration="2.138993916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:16:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:16:34.137252309 +0000 UTC m=+1750.386754114" watchObservedRunningTime="2026-09-20 01:16:34.138993916 +0000 UTC m=+1750.388495720"
Sep 20 01:16:34.743264 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.743217    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7608-0753cd"]
Sep 20 01:16:34.747087 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.747051    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7608-0753cd"]
Sep 20 01:16:34.875574 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.875499    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7608-a5cddb"]
Sep 20 01:16:34.875980 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.875962    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" containerName="test-curl-7608-0753cd"
Sep 20 01:16:34.876027 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.875983    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" containerName="test-curl-7608-0753cd"
Sep 20 01:16:34.876072 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.876060    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" containerName="test-curl-7608-0753cd"
Sep 20 01:16:34.879125 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.879108    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:34.884667 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.884644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7608-a5cddb"]
Sep 20 01:16:34.958991 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:34.958947    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b4v2\" (UniqueName: \"kubernetes.io/projected/9b8a5fce-2e74-40e6-8d52-567952604ce2-kube-api-access-6b4v2\") pod \"test-curl-7608-a5cddb\" (UID: \"9b8a5fce-2e74-40e6-8d52-567952604ce2\") " pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:35.060307 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:35.060268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b4v2\" (UniqueName: \"kubernetes.io/projected/9b8a5fce-2e74-40e6-8d52-567952604ce2-kube-api-access-6b4v2\") pod \"test-curl-7608-a5cddb\" (UID: \"9b8a5fce-2e74-40e6-8d52-567952604ce2\") " pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:35.067953 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:35.067910    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b4v2\" (UniqueName: \"kubernetes.io/projected/9b8a5fce-2e74-40e6-8d52-567952604ce2-kube-api-access-6b4v2\") pod \"test-curl-7608-a5cddb\" (UID: \"9b8a5fce-2e74-40e6-8d52-567952604ce2\") " pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:35.132192 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:16:35.132112    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7608-0753cd" container="test-curl-7608-0753cd"
Sep 20 01:16:35.190026 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:35.189993    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:35.458881 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:35.458855    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7608-a5cddb"]
Sep 20 01:16:35.460067 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:16:35.460041    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b8a5fce_2e74_40e6_8d52_567952604ce2.slice/crio-9ab0c0c12e0d91a92d661d8122d967cafb80e73e4a65bb9ca540f2b8c1567c45 WatchSource:0}: Error finding container 9ab0c0c12e0d91a92d661d8122d967cafb80e73e4a65bb9ca540f2b8c1567c45: Status 404 returned error can't find the container with id 9ab0c0c12e0d91a92d661d8122d967cafb80e73e4a65bb9ca540f2b8c1567c45
Sep 20 01:16:36.139310 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:36.139272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7608-a5cddb" event={"ID":"9b8a5fce-2e74-40e6-8d52-567952604ce2","Type":"ContainerStarted","Data":"dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c"}
Sep 20 01:16:36.139775 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:36.139324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7608-a5cddb" event={"ID":"9b8a5fce-2e74-40e6-8d52-567952604ce2","Type":"ContainerStarted","Data":"9ab0c0c12e0d91a92d661d8122d967cafb80e73e4a65bb9ca540f2b8c1567c45"}
Sep 20 01:16:36.139775 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:36.139358    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7608-0753cd" podUID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" containerName="test-curl-7608-0753cd" containerID="cri-o://708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c" gracePeriod=2
Sep 20 01:16:36.156291 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:36.156249    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7608-a5cddb" podStartSLOduration=2.15623414 podStartE2EDuration="2.15623414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:16:36.155305926 +0000 UTC m=+1752.404807728" watchObservedRunningTime="2026-09-20 01:16:36.15623414 +0000 UTC m=+1752.405735941"
Sep 20 01:16:36.743384 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:36.743348    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7608-a5cddb"]
Sep 20 01:16:36.747710 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:36.747674    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7608-a5cddb"]
Sep 20 01:16:37.145150 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:16:37.145118    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7608-a5cddb" container="test-curl-7608-a5cddb"
Sep 20 01:16:38.153602 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:38.153544    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7608-a5cddb" podUID="9b8a5fce-2e74-40e6-8d52-567952604ce2" containerName="test-curl-7608-a5cddb" containerID="cri-o://dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c" gracePeriod=2
Sep 20 01:16:38.326001 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:38.325976    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:38.389232 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:38.389197    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdgrw\" (UniqueName: \"kubernetes.io/projected/3cbe4e52-e058-41fe-b8bf-9752ed12d22e-kube-api-access-cdgrw\") pod \"3cbe4e52-e058-41fe-b8bf-9752ed12d22e\" (UID: \"3cbe4e52-e058-41fe-b8bf-9752ed12d22e\") "
Sep 20 01:16:38.391238 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:38.391210    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cbe4e52-e058-41fe-b8bf-9752ed12d22e-kube-api-access-cdgrw" (OuterVolumeSpecName: "kube-api-access-cdgrw") pod "3cbe4e52-e058-41fe-b8bf-9752ed12d22e" (UID: "3cbe4e52-e058-41fe-b8bf-9752ed12d22e"). InnerVolumeSpecName "kube-api-access-cdgrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:16:38.490359 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:38.490320    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdgrw\" (UniqueName: \"kubernetes.io/projected/3cbe4e52-e058-41fe-b8bf-9752ed12d22e-kube-api-access-cdgrw\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:16:39.160175 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:39.160134    2568 generic.go:356] "Generic (PLEG): container finished" podID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" containerID="708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c" exitCode=137
Sep 20 01:16:39.160609 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:39.160188    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:39.160609 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:39.160231    2568 scope.go:117] "RemoveContainer" containerID="708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c"
Sep 20 01:16:39.169825 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:39.169809    2568 scope.go:117] "RemoveContainer" containerID="708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c"
Sep 20 01:16:39.170120 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:16:39.170101    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c\": container with ID starting with 708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c not found: ID does not exist" containerID="708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c"
Sep 20 01:16:39.170181 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:39.170130    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c"} err="failed to get container status \"708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c\": rpc error: code = NotFound desc = could not find container \"708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c\": container with ID starting with 708abf9fd21121b0a26d5fe8201c2ec5947e68902f0a5691a42b5b0a2ed9cd3c not found: ID does not exist"
Sep 20 01:16:39.170949 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:16:39.170906    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7608-0753cd\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" pod="opendatahub/test-curl-7608-0753cd"
Sep 20 01:16:39.988094 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:39.988063    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cbe4e52-e058-41fe-b8bf-9752ed12d22e" path="/var/lib/kubelet/pods/3cbe4e52-e058-41fe-b8bf-9752ed12d22e/volumes"
Sep 20 01:16:40.333669 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:40.333640    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:40.407858 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:40.407823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b4v2\" (UniqueName: \"kubernetes.io/projected/9b8a5fce-2e74-40e6-8d52-567952604ce2-kube-api-access-6b4v2\") pod \"9b8a5fce-2e74-40e6-8d52-567952604ce2\" (UID: \"9b8a5fce-2e74-40e6-8d52-567952604ce2\") "
Sep 20 01:16:40.410040 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:40.410018    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8a5fce-2e74-40e6-8d52-567952604ce2-kube-api-access-6b4v2" (OuterVolumeSpecName: "kube-api-access-6b4v2") pod "9b8a5fce-2e74-40e6-8d52-567952604ce2" (UID: "9b8a5fce-2e74-40e6-8d52-567952604ce2"). InnerVolumeSpecName "kube-api-access-6b4v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:16:40.509220 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:40.509181    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b4v2\" (UniqueName: \"kubernetes.io/projected/9b8a5fce-2e74-40e6-8d52-567952604ce2-kube-api-access-6b4v2\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:16:41.174434 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:41.174393    2568 generic.go:356] "Generic (PLEG): container finished" podID="9b8a5fce-2e74-40e6-8d52-567952604ce2" containerID="dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c" exitCode=137
Sep 20 01:16:41.174622 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:41.174441    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:41.174622 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:41.174500    2568 scope.go:117] "RemoveContainer" containerID="dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c"
Sep 20 01:16:41.184086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:41.184049    2568 scope.go:117] "RemoveContainer" containerID="dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c"
Sep 20 01:16:41.184369 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:16:41.184342    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c\": container with ID starting with dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c not found: ID does not exist" containerID="dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c"
Sep 20 01:16:41.184435 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:41.184377    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c"} err="failed to get container status \"dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c\": rpc error: code = NotFound desc = could not find container \"dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c\": container with ID starting with dc58e9198e39cbf6fe58aa0989ad147bf2d3e9881c407c04d33010678279595c not found: ID does not exist"
Sep 20 01:16:41.184714 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:16:41.184693    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7608-a5cddb\" is forbidden: User \"system:node:ip-10-0-141-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-21.ec2.internal' and this object" podUID="9b8a5fce-2e74-40e6-8d52-567952604ce2" pod="opendatahub/test-curl-7608-a5cddb"
Sep 20 01:16:41.987257 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:16:41.987225    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8a5fce-2e74-40e6-8d52-567952604ce2" path="/var/lib/kubelet/pods/9b8a5fce-2e74-40e6-8d52-567952604ce2/volumes"
Sep 20 01:17:26.170688 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:17:26.170655    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:17:26.185529 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:17:26.185503    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:18:05.241332 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.241299    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"]
Sep 20 01:18:05.241793 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.241759    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8a5fce-2e74-40e6-8d52-567952604ce2" containerName="test-curl-7608-a5cddb"
Sep 20 01:18:05.241793 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.241775    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8a5fce-2e74-40e6-8d52-567952604ce2" containerName="test-curl-7608-a5cddb"
Sep 20 01:18:05.241930 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.241856    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8a5fce-2e74-40e6-8d52-567952604ce2" containerName="test-curl-7608-a5cddb"
Sep 20 01:18:05.245247 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.245225    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.247201 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.247182    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-e458de-serving-cert\""
Sep 20 01:18:05.258468 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.258443    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"]
Sep 20 01:18:05.280009 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.279981    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-metrics-certs\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.280134 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.280018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.280183 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.280156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f51575-e17c-4950-a44d-d59d320f422d-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.280237 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.280220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjhs\" (UniqueName: \"kubernetes.io/projected/b0f51575-e17c-4950-a44d-d59d320f422d-kube-api-access-qhjhs\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.381122 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.381082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-metrics-certs\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.381318 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.381130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.381318 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.381212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f51575-e17c-4950-a44d-d59d320f422d-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.381318 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.381263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjhs\" (UniqueName: \"kubernetes.io/projected/b0f51575-e17c-4950-a44d-d59d320f422d-kube-api-access-qhjhs\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.381318 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:18:05.381297    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-serving-cert: secret "maas-api-e2e-ipp-a-e458de-serving-cert" not found
Sep 20 01:18:05.381533 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:18:05.381393    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls podName:b0f51575-e17c-4950-a44d-d59d320f422d nodeName:}" failed. No retries permitted until 2026-09-20 01:18:05.881376174 +0000 UTC m=+1842.130877956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls") pod "maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" (UID: "b0f51575-e17c-4950-a44d-d59d320f422d") : secret "maas-api-e2e-ipp-a-e458de-serving-cert" not found
Sep 20 01:18:05.381958 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.381938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f51575-e17c-4950-a44d-d59d320f422d-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.383537 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.383520    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-metrics-certs\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.391387 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.391364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjhs\" (UniqueName: \"kubernetes.io/projected/b0f51575-e17c-4950-a44d-d59d320f422d-kube-api-access-qhjhs\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.885912 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.885870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:05.888491 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:05.888462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:06.157841 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:06.157750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:06.428461 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:06.428430    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"]
Sep 20 01:18:06.429963 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:18:06.429934    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f51575_e17c_4950_a44d_d59d320f422d.slice/crio-5922495b005aed5e01ec4b12d8a3066c7221b8808ac3156b046aae8c9703640e WatchSource:0}: Error finding container 5922495b005aed5e01ec4b12d8a3066c7221b8808ac3156b046aae8c9703640e: Status 404 returned error can't find the container with id 5922495b005aed5e01ec4b12d8a3066c7221b8808ac3156b046aae8c9703640e
Sep 20 01:18:06.431326 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:06.431304    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:18:06.678470 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:06.678384    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" event={"ID":"b0f51575-e17c-4950-a44d-d59d320f422d","Type":"ContainerStarted","Data":"5922495b005aed5e01ec4b12d8a3066c7221b8808ac3156b046aae8c9703640e"}
Sep 20 01:18:07.685026 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:07.684982    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" event={"ID":"b0f51575-e17c-4950-a44d-d59d320f422d","Type":"ContainerStarted","Data":"0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc"}
Sep 20 01:18:07.685515 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:07.685065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:07.704947 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:07.703083    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" podStartSLOduration=2.307376213 podStartE2EDuration="2.703063931s" totalImagesPullingTime="395.687718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:07.700218661 +0000 UTC m=+1843.949720465" watchObservedRunningTime="2026-09-20 01:18:07.703063931 +0000 UTC m=+1843.952565735"
Sep 20 01:18:13.696798 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:13.696766    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:18:35.005939 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.005880    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"]
Sep 20 01:18:35.009344 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.009320    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.011259 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.011227    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-63184c-serving-cert\""
Sep 20 01:18:35.020644 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.020615    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"]
Sep 20 01:18:35.159760 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.159720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ad277a-6d3a-46d4-9566-578061763cfc-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.159969 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.159767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.159969 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.159789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrhx\" (UniqueName: \"kubernetes.io/projected/05ad277a-6d3a-46d4-9566-578061763cfc-kube-api-access-ncrhx\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.159969 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.159866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-metrics-certs\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.260687 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.260594    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-metrics-certs\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.260869 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.260708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ad277a-6d3a-46d4-9566-578061763cfc-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.260869 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.260744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.260869 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.260772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrhx\" (UniqueName: \"kubernetes.io/projected/05ad277a-6d3a-46d4-9566-578061763cfc-kube-api-access-ncrhx\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.261077 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:18:35.260890    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-serving-cert: secret "maas-api-e2e-ipp-b-63184c-serving-cert" not found
Sep 20 01:18:35.261077 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:18:35.260979    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls podName:05ad277a-6d3a-46d4-9566-578061763cfc nodeName:}" failed. No retries permitted until 2026-09-20 01:18:35.760962886 +0000 UTC m=+1872.010464672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls") pod "maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" (UID: "05ad277a-6d3a-46d4-9566-578061763cfc") : secret "maas-api-e2e-ipp-b-63184c-serving-cert" not found
Sep 20 01:18:35.261461 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.261439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ad277a-6d3a-46d4-9566-578061763cfc-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.263095 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.263073    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-metrics-certs\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.269333 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.269307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrhx\" (UniqueName: \"kubernetes.io/projected/05ad277a-6d3a-46d4-9566-578061763cfc-kube-api-access-ncrhx\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.765232 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.765194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.767560 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.767536    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:35.927338 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:35.927285    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:36.202378 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:36.202347    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"]
Sep 20 01:18:36.203807 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:18:36.203780    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ad277a_6d3a_46d4_9566_578061763cfc.slice/crio-95c29c53460eb3aad624162357f616b077c104157b12649502a60f93a7648209 WatchSource:0}: Error finding container 95c29c53460eb3aad624162357f616b077c104157b12649502a60f93a7648209: Status 404 returned error can't find the container with id 95c29c53460eb3aad624162357f616b077c104157b12649502a60f93a7648209
Sep 20 01:18:36.868695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:36.868604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" event={"ID":"05ad277a-6d3a-46d4-9566-578061763cfc","Type":"ContainerStarted","Data":"fc7eb08572819ba5ffd1f88348eff9365fd276317e0624dddc502ef46a56c12c"}
Sep 20 01:18:36.868695 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:36.868686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" event={"ID":"05ad277a-6d3a-46d4-9566-578061763cfc","Type":"ContainerStarted","Data":"95c29c53460eb3aad624162357f616b077c104157b12649502a60f93a7648209"}
Sep 20 01:18:36.868902 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:36.868723    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:18:36.887160 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:36.887107    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" podStartSLOduration=2.494375592 podStartE2EDuration="2.887090694s" totalImagesPullingTime="392.715102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:36.885895904 +0000 UTC m=+1873.135397710" watchObservedRunningTime="2026-09-20 01:18:36.887090694 +0000 UTC m=+1873.136592497"
Sep 20 01:18:42.880836 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:18:42.880761    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:19:45.991908 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:45.991877    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"]
Sep 20 01:19:45.995789 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:45.995768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:45.997601 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:45.997577    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-e6d769-serving-cert\""
Sep 20 01:19:46.007049 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.007022    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"]
Sep 20 01:19:46.105265 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.105231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj8ss\" (UniqueName: \"kubernetes.io/projected/548de4b9-d8cc-42d7-9694-52698781d4c0-kube-api-access-cj8ss\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.105265 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.105274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.105493 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.105301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.105493 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.105386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548de4b9-d8cc-42d7-9694-52698781d4c0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.206589 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.206550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.206589 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.206589    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.206818 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.206618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548de4b9-d8cc-42d7-9694-52698781d4c0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.206818 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.206710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj8ss\" (UniqueName: \"kubernetes.io/projected/548de4b9-d8cc-42d7-9694-52698781d4c0-kube-api-access-cj8ss\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.207392 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.207368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548de4b9-d8cc-42d7-9694-52698781d4c0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.209039 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.209016    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.209157 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.209138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.213491 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.213468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj8ss\" (UniqueName: \"kubernetes.io/projected/548de4b9-d8cc-42d7-9694-52698781d4c0-kube-api-access-cj8ss\") pod \"maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.308312 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.308233    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:46.583770 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:46.583723    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"]
Sep 20 01:19:46.585102 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:19:46.585076    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548de4b9_d8cc_42d7_9694_52698781d4c0.slice/crio-0cb5e89a6beeb2f9ae023cc7b7bd1b52abe5e3e92b85da0776d3a2179b03fc69 WatchSource:0}: Error finding container 0cb5e89a6beeb2f9ae023cc7b7bd1b52abe5e3e92b85da0776d3a2179b03fc69: Status 404 returned error can't find the container with id 0cb5e89a6beeb2f9ae023cc7b7bd1b52abe5e3e92b85da0776d3a2179b03fc69
Sep 20 01:19:47.281569 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:47.281472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc" event={"ID":"548de4b9-d8cc-42d7-9694-52698781d4c0","Type":"ContainerStarted","Data":"92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884"}
Sep 20 01:19:47.281569 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:47.281539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc" event={"ID":"548de4b9-d8cc-42d7-9694-52698781d4c0","Type":"ContainerStarted","Data":"0cb5e89a6beeb2f9ae023cc7b7bd1b52abe5e3e92b85da0776d3a2179b03fc69"}
Sep 20 01:19:47.281569 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:47.281570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:19:47.298426 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:47.298373    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc" podStartSLOduration=1.921720806 podStartE2EDuration="2.298357406s" totalImagesPullingTime="376.6366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:19:47.296648846 +0000 UTC m=+1943.546150665" watchObservedRunningTime="2026-09-20 01:19:47.298357406 +0000 UTC m=+1943.547859209"
Sep 20 01:19:53.292346 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:19:53.292313    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:20:14.811330 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:14.811250    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"]
Sep 20 01:20:14.811722 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:14.811519    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc" podUID="548de4b9-d8cc-42d7-9694-52698781d4c0" containerName="maas-api" containerID="cri-o://92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884" gracePeriod=30
Sep 20 01:20:15.089353 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.089329    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:20:15.182050 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.182013    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-metrics-certs\") pod \"548de4b9-d8cc-42d7-9694-52698781d4c0\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") "
Sep 20 01:20:15.182221 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.182062    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj8ss\" (UniqueName: \"kubernetes.io/projected/548de4b9-d8cc-42d7-9694-52698781d4c0-kube-api-access-cj8ss\") pod \"548de4b9-d8cc-42d7-9694-52698781d4c0\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") "
Sep 20 01:20:15.182221 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.182190    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-maas-api-tls\") pod \"548de4b9-d8cc-42d7-9694-52698781d4c0\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") "
Sep 20 01:20:15.182303 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.182239    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548de4b9-d8cc-42d7-9694-52698781d4c0-openshift-service-ca\") pod \"548de4b9-d8cc-42d7-9694-52698781d4c0\" (UID: \"548de4b9-d8cc-42d7-9694-52698781d4c0\") "
Sep 20 01:20:15.182651 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.182625    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548de4b9-d8cc-42d7-9694-52698781d4c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "548de4b9-d8cc-42d7-9694-52698781d4c0" (UID: "548de4b9-d8cc-42d7-9694-52698781d4c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:15.184324 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.184293    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "548de4b9-d8cc-42d7-9694-52698781d4c0" (UID: "548de4b9-d8cc-42d7-9694-52698781d4c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:20:15.184324 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.184311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548de4b9-d8cc-42d7-9694-52698781d4c0-kube-api-access-cj8ss" (OuterVolumeSpecName: "kube-api-access-cj8ss") pod "548de4b9-d8cc-42d7-9694-52698781d4c0" (UID: "548de4b9-d8cc-42d7-9694-52698781d4c0"). InnerVolumeSpecName "kube-api-access-cj8ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:15.184471 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.184325    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "548de4b9-d8cc-42d7-9694-52698781d4c0" (UID: "548de4b9-d8cc-42d7-9694-52698781d4c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:20:15.283266 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.283225    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.283266 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.283267    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548de4b9-d8cc-42d7-9694-52698781d4c0-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.283472 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.283282    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548de4b9-d8cc-42d7-9694-52698781d4c0-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.283472 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.283296    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj8ss\" (UniqueName: \"kubernetes.io/projected/548de4b9-d8cc-42d7-9694-52698781d4c0-kube-api-access-cj8ss\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.455118 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.455080    2568 generic.go:356] "Generic (PLEG): container finished" podID="548de4b9-d8cc-42d7-9694-52698781d4c0" containerID="92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884" exitCode=0
Sep 20 01:20:15.455118 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.455120    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc" event={"ID":"548de4b9-d8cc-42d7-9694-52698781d4c0","Type":"ContainerDied","Data":"92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884"}
Sep 20 01:20:15.455388 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.455127    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"
Sep 20 01:20:15.455388 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.455162    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc" event={"ID":"548de4b9-d8cc-42d7-9694-52698781d4c0","Type":"ContainerDied","Data":"0cb5e89a6beeb2f9ae023cc7b7bd1b52abe5e3e92b85da0776d3a2179b03fc69"}
Sep 20 01:20:15.455388 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.455183    2568 scope.go:117] "RemoveContainer" containerID="92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884"
Sep 20 01:20:15.466995 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.466961    2568 scope.go:117] "RemoveContainer" containerID="92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884"
Sep 20 01:20:15.467440 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:20:15.467411    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884\": container with ID starting with 92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884 not found: ID does not exist" containerID="92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884"
Sep 20 01:20:15.467521 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.467443    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884"} err="failed to get container status \"92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884\": rpc error: code = NotFound desc = could not find container \"92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884\": container with ID starting with 92ac9c963e586d9dcb2dff806099fb6a98138bcbe8597cfd63bb1e14c6356884 not found: ID does not exist"
Sep 20 01:20:15.477969 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.477945    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"]
Sep 20 01:20:15.480388 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.480358    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e6d769-5874487c46-4xxkc"]
Sep 20 01:20:15.988253 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:15.988224    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="548de4b9-d8cc-42d7-9694-52698781d4c0" path="/var/lib/kubelet/pods/548de4b9-d8cc-42d7-9694-52698781d4c0/volumes"
Sep 20 01:20:40.574282 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.574248    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"]
Sep 20 01:20:40.574747 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.574491    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" podUID="b0f51575-e17c-4950-a44d-d59d320f422d" containerName="maas-api" containerID="cri-o://0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc" gracePeriod=30
Sep 20 01:20:40.832819 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.832753    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:20:40.937259 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.937228    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-metrics-certs\") pod \"b0f51575-e17c-4950-a44d-d59d320f422d\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") "
Sep 20 01:20:40.937444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.937281    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls\") pod \"b0f51575-e17c-4950-a44d-d59d320f422d\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") "
Sep 20 01:20:40.937444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.937345    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f51575-e17c-4950-a44d-d59d320f422d-openshift-service-ca\") pod \"b0f51575-e17c-4950-a44d-d59d320f422d\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") "
Sep 20 01:20:40.937444 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.937390    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhjhs\" (UniqueName: \"kubernetes.io/projected/b0f51575-e17c-4950-a44d-d59d320f422d-kube-api-access-qhjhs\") pod \"b0f51575-e17c-4950-a44d-d59d320f422d\" (UID: \"b0f51575-e17c-4950-a44d-d59d320f422d\") "
Sep 20 01:20:40.937816 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.937788    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0f51575-e17c-4950-a44d-d59d320f422d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0f51575-e17c-4950-a44d-d59d320f422d" (UID: "b0f51575-e17c-4950-a44d-d59d320f422d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:40.939430 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.939404    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0f51575-e17c-4950-a44d-d59d320f422d" (UID: "b0f51575-e17c-4950-a44d-d59d320f422d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:20:40.939531 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.939463    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0f51575-e17c-4950-a44d-d59d320f422d-kube-api-access-qhjhs" (OuterVolumeSpecName: "kube-api-access-qhjhs") pod "b0f51575-e17c-4950-a44d-d59d320f422d" (UID: "b0f51575-e17c-4950-a44d-d59d320f422d"). InnerVolumeSpecName "kube-api-access-qhjhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:40.939531 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:40.939468    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b0f51575-e17c-4950-a44d-d59d320f422d" (UID: "b0f51575-e17c-4950-a44d-d59d320f422d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:20:41.038443 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.038402    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.038443 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.038439    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0f51575-e17c-4950-a44d-d59d320f422d-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.038657 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.038454    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f51575-e17c-4950-a44d-d59d320f422d-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.038657 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.038469    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhjhs\" (UniqueName: \"kubernetes.io/projected/b0f51575-e17c-4950-a44d-d59d320f422d-kube-api-access-qhjhs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.607578 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.607540    2568 generic.go:356] "Generic (PLEG): container finished" podID="b0f51575-e17c-4950-a44d-d59d320f422d" containerID="0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc" exitCode=0
Sep 20 01:20:41.608086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.607583    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"
Sep 20 01:20:41.608086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.607602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" event={"ID":"b0f51575-e17c-4950-a44d-d59d320f422d","Type":"ContainerDied","Data":"0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc"}
Sep 20 01:20:41.608086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.607658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4" event={"ID":"b0f51575-e17c-4950-a44d-d59d320f422d","Type":"ContainerDied","Data":"5922495b005aed5e01ec4b12d8a3066c7221b8808ac3156b046aae8c9703640e"}
Sep 20 01:20:41.608086 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.607690    2568 scope.go:117] "RemoveContainer" containerID="0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc"
Sep 20 01:20:41.617798 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.617779    2568 scope.go:117] "RemoveContainer" containerID="0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc"
Sep 20 01:20:41.618128 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:20:41.618105    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc\": container with ID starting with 0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc not found: ID does not exist" containerID="0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc"
Sep 20 01:20:41.618213 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.618135    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc"} err="failed to get container status \"0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc\": rpc error: code = NotFound desc = could not find container \"0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc\": container with ID starting with 0dd1d234dde45066763ccc6938c77fb2dc52d425deb911056f76254f283301bc not found: ID does not exist"
Sep 20 01:20:41.635323 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.631417    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"]
Sep 20 01:20:41.639690 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.639659    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e458de-79d598fd89-pv4c4"]
Sep 20 01:20:41.987811 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:20:41.987774    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0f51575-e17c-4950-a44d-d59d320f422d" path="/var/lib/kubelet/pods/b0f51575-e17c-4950-a44d-d59d320f422d/volumes"
Sep 20 01:21:39.829078 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:39.828982    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"]
Sep 20 01:21:39.829656 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:39.829235    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" podUID="05ad277a-6d3a-46d4-9566-578061763cfc" containerName="maas-api" containerID="cri-o://fc7eb08572819ba5ffd1f88348eff9365fd276317e0624dddc502ef46a56c12c" gracePeriod=30
Sep 20 01:21:39.951166 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:39.951129    2568 generic.go:356] "Generic (PLEG): container finished" podID="05ad277a-6d3a-46d4-9566-578061763cfc" containerID="fc7eb08572819ba5ffd1f88348eff9365fd276317e0624dddc502ef46a56c12c" exitCode=0
Sep 20 01:21:39.951295 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:39.951204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" event={"ID":"05ad277a-6d3a-46d4-9566-578061763cfc","Type":"ContainerDied","Data":"fc7eb08572819ba5ffd1f88348eff9365fd276317e0624dddc502ef46a56c12c"}
Sep 20 01:21:40.088328 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.088267    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:21:40.193061 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.193026    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls\") pod \"05ad277a-6d3a-46d4-9566-578061763cfc\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") "
Sep 20 01:21:40.193245 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.193068    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ad277a-6d3a-46d4-9566-578061763cfc-openshift-service-ca\") pod \"05ad277a-6d3a-46d4-9566-578061763cfc\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") "
Sep 20 01:21:40.193245 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.193171    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-metrics-certs\") pod \"05ad277a-6d3a-46d4-9566-578061763cfc\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") "
Sep 20 01:21:40.193245 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.193214    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncrhx\" (UniqueName: \"kubernetes.io/projected/05ad277a-6d3a-46d4-9566-578061763cfc-kube-api-access-ncrhx\") pod \"05ad277a-6d3a-46d4-9566-578061763cfc\" (UID: \"05ad277a-6d3a-46d4-9566-578061763cfc\") "
Sep 20 01:21:40.193492 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.193455    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ad277a-6d3a-46d4-9566-578061763cfc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05ad277a-6d3a-46d4-9566-578061763cfc" (UID: "05ad277a-6d3a-46d4-9566-578061763cfc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:40.195417 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.195384    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05ad277a-6d3a-46d4-9566-578061763cfc" (UID: "05ad277a-6d3a-46d4-9566-578061763cfc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:21:40.195417 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.195402    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "05ad277a-6d3a-46d4-9566-578061763cfc" (UID: "05ad277a-6d3a-46d4-9566-578061763cfc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:21:40.195585 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.195489    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ad277a-6d3a-46d4-9566-578061763cfc-kube-api-access-ncrhx" (OuterVolumeSpecName: "kube-api-access-ncrhx") pod "05ad277a-6d3a-46d4-9566-578061763cfc" (UID: "05ad277a-6d3a-46d4-9566-578061763cfc"). InnerVolumeSpecName "kube-api-access-ncrhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:40.294138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.294099    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.294138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.294134    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncrhx\" (UniqueName: \"kubernetes.io/projected/05ad277a-6d3a-46d4-9566-578061763cfc-kube-api-access-ncrhx\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.294138 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.294144    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ad277a-6d3a-46d4-9566-578061763cfc-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.294399 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.294153    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ad277a-6d3a-46d4-9566-578061763cfc-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.958740 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.958704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl" event={"ID":"05ad277a-6d3a-46d4-9566-578061763cfc","Type":"ContainerDied","Data":"95c29c53460eb3aad624162357f616b077c104157b12649502a60f93a7648209"}
Sep 20 01:21:40.959199 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.958716    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"
Sep 20 01:21:40.959199 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.958801    2568 scope.go:117] "RemoveContainer" containerID="fc7eb08572819ba5ffd1f88348eff9365fd276317e0624dddc502ef46a56c12c"
Sep 20 01:21:40.979107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.979077    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"]
Sep 20 01:21:40.986840 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:40.986813    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-63184c-58655bf77b-pj7nl"]
Sep 20 01:21:41.987057 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:41.987023    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ad277a-6d3a-46d4-9566-578061763cfc" path="/var/lib/kubelet/pods/05ad277a-6d3a-46d4-9566-578061763cfc/volumes"
Sep 20 01:21:57.457424 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.457376    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"]
Sep 20 01:21:57.457882 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.457831    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r" podUID="4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" containerName="maas-api" containerID="cri-o://1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648" gracePeriod=30
Sep 20 01:21:57.711058 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.710992    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:21:57.862837 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.862800    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-metrics-certs\") pod \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") "
Sep 20 01:21:57.863059 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.862878    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-openshift-service-ca\") pod \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") "
Sep 20 01:21:57.863059 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.863006    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-maas-api-tls\") pod \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") "
Sep 20 01:21:57.863059 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.863032    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpqxt\" (UniqueName: \"kubernetes.io/projected/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-kube-api-access-gpqxt\") pod \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\" (UID: \"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18\") "
Sep 20 01:21:57.863701 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.863666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" (UID: "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:57.865632 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.865603    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" (UID: "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:21:57.865735 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.865631    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" (UID: "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:21:57.866103 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.866076    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-kube-api-access-gpqxt" (OuterVolumeSpecName: "kube-api-access-gpqxt") pod "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" (UID: "4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18"). InnerVolumeSpecName "kube-api-access-gpqxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:57.964111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.964024    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:57.964111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.964051    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpqxt\" (UniqueName: \"kubernetes.io/projected/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-kube-api-access-gpqxt\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:57.964111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.964063    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:57.964111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:57.964071    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:21:58.058686 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.058648    2568 generic.go:356] "Generic (PLEG): container finished" podID="4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" containerID="1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648" exitCode=0
Sep 20 01:21:58.058871 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.058708    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"
Sep 20 01:21:58.058871 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.058740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r" event={"ID":"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18","Type":"ContainerDied","Data":"1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648"}
Sep 20 01:21:58.058871 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.058797    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r" event={"ID":"4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18","Type":"ContainerDied","Data":"fcebe33d64076e7f8fd80f14ff04a122d415e28856f6bbe1e791f93c72abb3f0"}
Sep 20 01:21:58.058871 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.058825    2568 scope.go:117] "RemoveContainer" containerID="1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648"
Sep 20 01:21:58.071797 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.071386    2568 scope.go:117] "RemoveContainer" containerID="1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648"
Sep 20 01:21:58.072143 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:21:58.072118    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648\": container with ID starting with 1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648 not found: ID does not exist" containerID="1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648"
Sep 20 01:21:58.072296 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.072153    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648"} err="failed to get container status \"1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648\": rpc error: code = NotFound desc = could not find container \"1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648\": container with ID starting with 1a39a424eab0590fbdc6f0088675c94f1005e7804c20ae32afef833f10c7f648 not found: ID does not exist"
Sep 20 01:21:58.074347 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.074322    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"]
Sep 20 01:21:58.077947 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:58.077909    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d1662a-7b55f5bc75-8556r"]
Sep 20 01:21:59.987850 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:21:59.987806    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" path="/var/lib/kubelet/pods/4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18/volumes"
Sep 20 01:22:14.835690 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:14.835646    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"]
Sep 20 01:22:14.836347 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:14.835905    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp" podUID="72726f1e-1f54-4c8b-ab43-fc80f9208ddd" containerName="maas-api" containerID="cri-o://7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe" gracePeriod=30
Sep 20 01:22:15.093437 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.093378    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:22:15.160592 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.160561    2568 generic.go:356] "Generic (PLEG): container finished" podID="72726f1e-1f54-4c8b-ab43-fc80f9208ddd" containerID="7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe" exitCode=0
Sep 20 01:22:15.160784 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.160636    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"
Sep 20 01:22:15.160784 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.160648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp" event={"ID":"72726f1e-1f54-4c8b-ab43-fc80f9208ddd","Type":"ContainerDied","Data":"7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe"}
Sep 20 01:22:15.160784 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.160747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp" event={"ID":"72726f1e-1f54-4c8b-ab43-fc80f9208ddd","Type":"ContainerDied","Data":"d54f2bb2aa3c2a915dc2774bc8d616b72726e3b551be563a2a56d36035793e58"}
Sep 20 01:22:15.160784 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.160778    2568 scope.go:117] "RemoveContainer" containerID="7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe"
Sep 20 01:22:15.170684 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.170664    2568 scope.go:117] "RemoveContainer" containerID="7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe"
Sep 20 01:22:15.170991 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:22:15.170966    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe\": container with ID starting with 7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe not found: ID does not exist" containerID="7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe"
Sep 20 01:22:15.171099 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.171004    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe"} err="failed to get container status \"7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe\": rpc error: code = NotFound desc = could not find container \"7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe\": container with ID starting with 7289a8c4657340511b547b12712ca1de259e754ac7d427aa4dbf2a1c791f5bfe not found: ID does not exist"
Sep 20 01:22:15.221639 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.221608    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-maas-api-tls\") pod \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") "
Sep 20 01:22:15.222062 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.221746    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-metrics-certs\") pod \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") "
Sep 20 01:22:15.222062 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.221790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djx8f\" (UniqueName: \"kubernetes.io/projected/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-kube-api-access-djx8f\") pod \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") "
Sep 20 01:22:15.222062 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.221823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-openshift-service-ca\") pod \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\" (UID: \"72726f1e-1f54-4c8b-ab43-fc80f9208ddd\") "
Sep 20 01:22:15.222285 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.222235    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72726f1e-1f54-4c8b-ab43-fc80f9208ddd" (UID: "72726f1e-1f54-4c8b-ab43-fc80f9208ddd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:22:15.223876 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.223847    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72726f1e-1f54-4c8b-ab43-fc80f9208ddd" (UID: "72726f1e-1f54-4c8b-ab43-fc80f9208ddd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:22:15.224009 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.223884    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "72726f1e-1f54-4c8b-ab43-fc80f9208ddd" (UID: "72726f1e-1f54-4c8b-ab43-fc80f9208ddd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:22:15.224009 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.223903    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-kube-api-access-djx8f" (OuterVolumeSpecName: "kube-api-access-djx8f") pod "72726f1e-1f54-4c8b-ab43-fc80f9208ddd" (UID: "72726f1e-1f54-4c8b-ab43-fc80f9208ddd"). InnerVolumeSpecName "kube-api-access-djx8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:15.322893 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.322855    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.322893 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.322888    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.322893 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.322897    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djx8f\" (UniqueName: \"kubernetes.io/projected/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-kube-api-access-djx8f\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.323182 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.322909    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72726f1e-1f54-4c8b-ab43-fc80f9208ddd-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.482422 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.482390    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"]
Sep 20 01:22:15.485566 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.485542    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c93ee-68c6549d99-457cp"]
Sep 20 01:22:15.989066 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:15.989033    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72726f1e-1f54-4c8b-ab43-fc80f9208ddd" path="/var/lib/kubelet/pods/72726f1e-1f54-4c8b-ab43-fc80f9208ddd/volumes"
Sep 20 01:22:24.209510 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.209475    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df4664d44-v7v4q"]
Sep 20 01:22:24.210029 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.209705    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5df4664d44-v7v4q" podUID="84c4e3d3-f618-4154-8530-33bb95578e8b" containerName="manager" containerID="cri-o://06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2" gracePeriod=30
Sep 20 01:22:24.465906 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.465845    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 01:22:24.608729 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.608695    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d2cn\" (UniqueName: \"kubernetes.io/projected/84c4e3d3-f618-4154-8530-33bb95578e8b-kube-api-access-7d2cn\") pod \"84c4e3d3-f618-4154-8530-33bb95578e8b\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") "
Sep 20 01:22:24.608895 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.608794    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-webhook-cert\") pod \"84c4e3d3-f618-4154-8530-33bb95578e8b\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") "
Sep 20 01:22:24.608979 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.608895    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-metrics-certs\") pod \"84c4e3d3-f618-4154-8530-33bb95578e8b\" (UID: \"84c4e3d3-f618-4154-8530-33bb95578e8b\") "
Sep 20 01:22:24.610822 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.610795    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "84c4e3d3-f618-4154-8530-33bb95578e8b" (UID: "84c4e3d3-f618-4154-8530-33bb95578e8b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:22:24.610964 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.610852    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "84c4e3d3-f618-4154-8530-33bb95578e8b" (UID: "84c4e3d3-f618-4154-8530-33bb95578e8b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:22:24.610964 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.610891    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c4e3d3-f618-4154-8530-33bb95578e8b-kube-api-access-7d2cn" (OuterVolumeSpecName: "kube-api-access-7d2cn") pod "84c4e3d3-f618-4154-8530-33bb95578e8b" (UID: "84c4e3d3-f618-4154-8530-33bb95578e8b"). InnerVolumeSpecName "kube-api-access-7d2cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:24.710402 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.710368    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-webhook-cert\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:24.710402 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.710395    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c4e3d3-f618-4154-8530-33bb95578e8b-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:24.710402 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:24.710404    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d2cn\" (UniqueName: \"kubernetes.io/projected/84c4e3d3-f618-4154-8530-33bb95578e8b-kube-api-access-7d2cn\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:22:25.221095 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.221054    2568 generic.go:356] "Generic (PLEG): container finished" podID="84c4e3d3-f618-4154-8530-33bb95578e8b" containerID="06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2" exitCode=0
Sep 20 01:22:25.221501 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.221104    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-v7v4q"
Sep 20 01:22:25.221501 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.221110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-v7v4q" event={"ID":"84c4e3d3-f618-4154-8530-33bb95578e8b","Type":"ContainerDied","Data":"06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2"}
Sep 20 01:22:25.221501 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.221163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-v7v4q" event={"ID":"84c4e3d3-f618-4154-8530-33bb95578e8b","Type":"ContainerDied","Data":"35a710eed05ba791c65a745a373e82982cbc6d721f68ae9ae01a28d1ac9f6c62"}
Sep 20 01:22:25.221501 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.221196    2568 scope.go:117] "RemoveContainer" containerID="06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2"
Sep 20 01:22:25.231952 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.231932    2568 scope.go:117] "RemoveContainer" containerID="06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2"
Sep 20 01:22:25.232249 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:22:25.232226    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2\": container with ID starting with 06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2 not found: ID does not exist" containerID="06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2"
Sep 20 01:22:25.232339 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.232256    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2"} err="failed to get container status \"06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2\": rpc error: code = NotFound desc = could not find container \"06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2\": container with ID starting with 06f0b090f43cf16b811aaae377ef6a760b855fea0ddc53e67ee1c083a44301d2 not found: ID does not exist"
Sep 20 01:22:25.244511 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.244485    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df4664d44-v7v4q"]
Sep 20 01:22:25.249591 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.249567    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df4664d44-v7v4q"]
Sep 20 01:22:25.988605 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:25.988573    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c4e3d3-f618-4154-8530-33bb95578e8b" path="/var/lib/kubelet/pods/84c4e3d3-f618-4154-8530-33bb95578e8b/volumes"
Sep 20 01:22:26.207728 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:26.207699    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:22:26.224533 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:22:26.224507    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:23:26.018846 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.018765    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df4664d44-9ckps"]
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019140    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c4e3d3-f618-4154-8530-33bb95578e8b" containerName="manager"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019153    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c4e3d3-f618-4154-8530-33bb95578e8b" containerName="manager"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019164    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ad277a-6d3a-46d4-9566-578061763cfc" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019171    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ad277a-6d3a-46d4-9566-578061763cfc" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019179    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548de4b9-d8cc-42d7-9694-52698781d4c0" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019184    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="548de4b9-d8cc-42d7-9694-52698781d4c0" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019191    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72726f1e-1f54-4c8b-ab43-fc80f9208ddd" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019196    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="72726f1e-1f54-4c8b-ab43-fc80f9208ddd" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019204    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019209    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019219    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0f51575-e17c-4950-a44d-d59d320f422d" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019224    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0f51575-e17c-4950-a44d-d59d320f422d" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019282    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="72726f1e-1f54-4c8b-ab43-fc80f9208ddd" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019292    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c4e3d3-f618-4154-8530-33bb95578e8b" containerName="manager"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019297    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0f51575-e17c-4950-a44d-d59d320f422d" containerName="maas-api"
Sep 20 01:23:26.019298 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019303    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="548de4b9-d8cc-42d7-9694-52698781d4c0" containerName="maas-api"
Sep 20 01:23:26.019898 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019309    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1c3527-b0e1-4e4f-881b-da6a5ca8ee18" containerName="maas-api"
Sep 20 01:23:26.019898 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.019317    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ad277a-6d3a-46d4-9566-578061763cfc" containerName="maas-api"
Sep 20 01:23:26.022002 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.021986    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.024780 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.024757    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 20 01:23:26.025012 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.024997    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 20 01:23:26.025107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.025018    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ts75m\""
Sep 20 01:23:26.025107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.025026    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 20 01:23:26.031986 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.031960    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9ckps"]
Sep 20 01:23:26.162710 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.162677    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qb8\" (UniqueName: \"kubernetes.io/projected/04d4a6eb-64ae-4c39-9e86-24526501f691-kube-api-access-g2qb8\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.162871 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.162718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-metrics-certs\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.162871 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.162777    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-webhook-cert\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.264449 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.264414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qb8\" (UniqueName: \"kubernetes.io/projected/04d4a6eb-64ae-4c39-9e86-24526501f691-kube-api-access-g2qb8\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.264618 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.264460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-metrics-certs\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.264618 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.264506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-webhook-cert\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.267050 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.267027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-metrics-certs\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.267169 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.267053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-webhook-cert\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.271459 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.271402    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qb8\" (UniqueName: \"kubernetes.io/projected/04d4a6eb-64ae-4c39-9e86-24526501f691-kube-api-access-g2qb8\") pod \"maas-controller-5df4664d44-9ckps\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") " pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.333483 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.333441    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:26.604993 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.604964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9ckps"]
Sep 20 01:23:26.607763 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:23:26.607740    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d4a6eb_64ae_4c39_9e86_24526501f691.slice/crio-3eeb0b51583bf50c5e7170e87b3e70127b8ab18696d075309c0206a0b90c2ca4 WatchSource:0}: Error finding container 3eeb0b51583bf50c5e7170e87b3e70127b8ab18696d075309c0206a0b90c2ca4: Status 404 returned error can't find the container with id 3eeb0b51583bf50c5e7170e87b3e70127b8ab18696d075309c0206a0b90c2ca4
Sep 20 01:23:26.609538 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:26.609523    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:23:27.566391 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:27.566345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-9ckps" event={"ID":"04d4a6eb-64ae-4c39-9e86-24526501f691","Type":"ContainerStarted","Data":"efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903"}
Sep 20 01:23:27.566857 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:27.566421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:27.566857 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:27.566446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-9ckps" event={"ID":"04d4a6eb-64ae-4c39-9e86-24526501f691","Type":"ContainerStarted","Data":"3eeb0b51583bf50c5e7170e87b3e70127b8ab18696d075309c0206a0b90c2ca4"}
Sep 20 01:23:27.582115 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:27.582064    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df4664d44-9ckps" podStartSLOduration=1.141412975 podStartE2EDuration="1.582048874s" totalImagesPullingTime="440.635899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:23:27.580836057 +0000 UTC m=+2163.830337861" watchObservedRunningTime="2026-09-20 01:23:27.582048874 +0000 UTC m=+2163.831550677"
Sep 20 01:23:38.575443 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:38.575410    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:45.763939 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:45.763888    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9ckps"]
Sep 20 01:23:45.764450 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:45.764209    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5df4664d44-9ckps" podUID="04d4a6eb-64ae-4c39-9e86-24526501f691" containerName="manager" containerID="cri-o://efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903" gracePeriod=30
Sep 20 01:23:46.010502 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.010477    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:46.026720 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.026584    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-webhook-cert\") pod \"04d4a6eb-64ae-4c39-9e86-24526501f691\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") "
Sep 20 01:23:46.026720 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.026626    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-metrics-certs\") pod \"04d4a6eb-64ae-4c39-9e86-24526501f691\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") "
Sep 20 01:23:46.026720 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.026688    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2qb8\" (UniqueName: \"kubernetes.io/projected/04d4a6eb-64ae-4c39-9e86-24526501f691-kube-api-access-g2qb8\") pod \"04d4a6eb-64ae-4c39-9e86-24526501f691\" (UID: \"04d4a6eb-64ae-4c39-9e86-24526501f691\") "
Sep 20 01:23:46.029668 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.029636    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "04d4a6eb-64ae-4c39-9e86-24526501f691" (UID: "04d4a6eb-64ae-4c39-9e86-24526501f691"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:23:46.029792 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.029677    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "04d4a6eb-64ae-4c39-9e86-24526501f691" (UID: "04d4a6eb-64ae-4c39-9e86-24526501f691"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:23:46.030144 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.030119    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d4a6eb-64ae-4c39-9e86-24526501f691-kube-api-access-g2qb8" (OuterVolumeSpecName: "kube-api-access-g2qb8") pod "04d4a6eb-64ae-4c39-9e86-24526501f691" (UID: "04d4a6eb-64ae-4c39-9e86-24526501f691"). InnerVolumeSpecName "kube-api-access-g2qb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:23:46.127410 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.127377    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-webhook-cert\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:23:46.127410 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.127405    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d4a6eb-64ae-4c39-9e86-24526501f691-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:23:46.127410 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.127414    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2qb8\" (UniqueName: \"kubernetes.io/projected/04d4a6eb-64ae-4c39-9e86-24526501f691-kube-api-access-g2qb8\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:23:46.675487 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.675449    2568 generic.go:356] "Generic (PLEG): container finished" podID="04d4a6eb-64ae-4c39-9e86-24526501f691" containerID="efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903" exitCode=0
Sep 20 01:23:46.675666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.675492    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-9ckps"
Sep 20 01:23:46.675666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.675536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-9ckps" event={"ID":"04d4a6eb-64ae-4c39-9e86-24526501f691","Type":"ContainerDied","Data":"efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903"}
Sep 20 01:23:46.675666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.675593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-9ckps" event={"ID":"04d4a6eb-64ae-4c39-9e86-24526501f691","Type":"ContainerDied","Data":"3eeb0b51583bf50c5e7170e87b3e70127b8ab18696d075309c0206a0b90c2ca4"}
Sep 20 01:23:46.675666 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.675615    2568 scope.go:117] "RemoveContainer" containerID="efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903"
Sep 20 01:23:46.685258 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.685233    2568 scope.go:117] "RemoveContainer" containerID="efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903"
Sep 20 01:23:46.685532 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:23:46.685512    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903\": container with ID starting with efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903 not found: ID does not exist" containerID="efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903"
Sep 20 01:23:46.685620 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.685540    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903"} err="failed to get container status \"efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903\": rpc error: code = NotFound desc = could not find container \"efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903\": container with ID starting with efd1553316676bf7393427c89a9571e15e7f7dc186397cabf295a59057675903 not found: ID does not exist"
Sep 20 01:23:46.695689 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.695663    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9ckps"]
Sep 20 01:23:46.699311 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:46.699292    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9ckps"]
Sep 20 01:23:47.627730 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.627689    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df4664d44-9cqj2"]
Sep 20 01:23:47.628145 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.628111    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d4a6eb-64ae-4c39-9e86-24526501f691" containerName="manager"
Sep 20 01:23:47.628145 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.628125    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d4a6eb-64ae-4c39-9e86-24526501f691" containerName="manager"
Sep 20 01:23:47.628219 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.628205    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d4a6eb-64ae-4c39-9e86-24526501f691" containerName="manager"
Sep 20 01:23:47.632711 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.632687    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.635328 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.635303    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 20 01:23:47.635449 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.635361    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 20 01:23:47.635449 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.635392    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ts75m\""
Sep 20 01:23:47.635449 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.635399    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 20 01:23:47.636019 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.636002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-metrics-certs\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.636111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.636070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpfvn\" (UniqueName: \"kubernetes.io/projected/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-kube-api-access-hpfvn\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.636111 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.636100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-webhook-cert\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.641646 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.641622    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9cqj2"]
Sep 20 01:23:47.736881 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.736851    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-metrics-certs\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.737107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.736907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpfvn\" (UniqueName: \"kubernetes.io/projected/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-kube-api-access-hpfvn\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.737107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.736940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-webhook-cert\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.739377 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.739345    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-webhook-cert\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.739490 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.739433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-metrics-certs\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.746553 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.746529    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpfvn\" (UniqueName: \"kubernetes.io/projected/eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998-kube-api-access-hpfvn\") pod \"maas-controller-5df4664d44-9cqj2\" (UID: \"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998\") " pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.943764 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.943728    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:47.987993 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:47.987963    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d4a6eb-64ae-4c39-9e86-24526501f691" path="/var/lib/kubelet/pods/04d4a6eb-64ae-4c39-9e86-24526501f691/volumes"
Sep 20 01:23:48.214940 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:48.214881    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4664d44-9cqj2"]
Sep 20 01:23:48.216472 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:23:48.216447    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca7f3bc_ecd4_4332_ad08_4bbc9cbe1998.slice/crio-328d22532b7fa122b2492036916696d035f5b82d3de56f601c926ef841401d52 WatchSource:0}: Error finding container 328d22532b7fa122b2492036916696d035f5b82d3de56f601c926ef841401d52: Status 404 returned error can't find the container with id 328d22532b7fa122b2492036916696d035f5b82d3de56f601c926ef841401d52
Sep 20 01:23:48.688182 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:48.688149    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-9cqj2" event={"ID":"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998","Type":"ContainerStarted","Data":"328d22532b7fa122b2492036916696d035f5b82d3de56f601c926ef841401d52"}
Sep 20 01:23:49.695512 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:49.695475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4664d44-9cqj2" event={"ID":"eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998","Type":"ContainerStarted","Data":"f23bd297ed75295a280406ea50e46c775fe308f020ee5d305c53edfb9c1f7216"}
Sep 20 01:23:49.696040 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:49.695619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:23:49.712547 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:23:49.712501    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df4664d44-9cqj2" podStartSLOduration=2.059752375 podStartE2EDuration="2.712485857s" totalImagesPullingTime="652.733482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:23:49.711339479 +0000 UTC m=+2185.960841281" watchObservedRunningTime="2026-09-20 01:23:49.712485857 +0000 UTC m=+2185.961987710"
Sep 20 01:24:00.704062 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:24:00.704030    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df4664d44-9cqj2"
Sep 20 01:25:17.619905 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.619860    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"]
Sep 20 01:25:17.620479 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.620212    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager" containerID="cri-o://2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6" gracePeriod=10
Sep 20 01:25:17.870713 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.870654    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 01:25:17.948074 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.948039    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a7551ec-27ab-43e5-a675-c627df0bf4b4-extensions-socket-volume\") pod \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") "
Sep 20 01:25:17.948263 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.948175    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnf84\" (UniqueName: \"kubernetes.io/projected/1a7551ec-27ab-43e5-a675-c627df0bf4b4-kube-api-access-rnf84\") pod \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\" (UID: \"1a7551ec-27ab-43e5-a675-c627df0bf4b4\") "
Sep 20 01:25:17.948476 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.948449    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7551ec-27ab-43e5-a675-c627df0bf4b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1a7551ec-27ab-43e5-a675-c627df0bf4b4" (UID: "1a7551ec-27ab-43e5-a675-c627df0bf4b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:25:17.950204 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:17.950174    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7551ec-27ab-43e5-a675-c627df0bf4b4-kube-api-access-rnf84" (OuterVolumeSpecName: "kube-api-access-rnf84") pod "1a7551ec-27ab-43e5-a675-c627df0bf4b4" (UID: "1a7551ec-27ab-43e5-a675-c627df0bf4b4"). InnerVolumeSpecName "kube-api-access-rnf84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:25:18.049754 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.049715    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnf84\" (UniqueName: \"kubernetes.io/projected/1a7551ec-27ab-43e5-a675-c627df0bf4b4-kube-api-access-rnf84\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:25:18.049754 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.049747    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a7551ec-27ab-43e5-a675-c627df0bf4b4-extensions-socket-volume\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:25:18.197327 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.197297    2568 generic.go:356] "Generic (PLEG): container finished" podID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerID="2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6" exitCode=0
Sep 20 01:25:18.197482 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.197342    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"
Sep 20 01:25:18.197482 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.197376    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" event={"ID":"1a7551ec-27ab-43e5-a675-c627df0bf4b4","Type":"ContainerDied","Data":"2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6"}
Sep 20 01:25:18.197482 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.197431    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj" event={"ID":"1a7551ec-27ab-43e5-a675-c627df0bf4b4","Type":"ContainerDied","Data":"6750bba3c64cd47cb56a309126469b2d52945cb9a83d56ca070c6a9cd9910d79"}
Sep 20 01:25:18.197482 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.197456    2568 scope.go:117] "RemoveContainer" containerID="2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6"
Sep 20 01:25:18.206832 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.206811    2568 scope.go:117] "RemoveContainer" containerID="5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"
Sep 20 01:25:18.212699 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.212676    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"]
Sep 20 01:25:18.215719 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.215702    2568 scope.go:117] "RemoveContainer" containerID="2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6"
Sep 20 01:25:18.215996 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:25:18.215976    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6\": container with ID starting with 2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6 not found: ID does not exist" containerID="2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6"
Sep 20 01:25:18.216059 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.216003    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6"} err="failed to get container status \"2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6\": rpc error: code = NotFound desc = could not find container \"2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6\": container with ID starting with 2e2200923d9eacad5e18d35221d20a9f89323bf89c32129be9012c3bd24b1ea6 not found: ID does not exist"
Sep 20 01:25:18.216059 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.216019    2568 scope.go:117] "RemoveContainer" containerID="5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"
Sep 20 01:25:18.216274 ip-10-0-141-21 kubenswrapper[2568]: E0920 01:25:18.216256    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e\": container with ID starting with 5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e not found: ID does not exist" containerID="5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"
Sep 20 01:25:18.216319 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.216283    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e"} err="failed to get container status \"5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e\": rpc error: code = NotFound desc = could not find container \"5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e\": container with ID starting with 5c0803a2a6c2a048341be43e248b33c8ff68896064de7d098676c62d2b50376e not found: ID does not exist"
Sep 20 01:25:18.216645 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:18.216627    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kt7cj"]
Sep 20 01:25:19.987321 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:25:19.987286    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" path="/var/lib/kubelet/pods/1a7551ec-27ab-43e5-a675-c627df0bf4b4/volumes"
Sep 20 01:26:18.289657 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.289578    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"]
Sep 20 01:26:18.290356 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.289969    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager"
Sep 20 01:26:18.290356 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.289981    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager"
Sep 20 01:26:18.290356 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.290056    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager"
Sep 20 01:26:18.290356 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.290066    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager"
Sep 20 01:26:18.293132 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.293116    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.295311 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.295294    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nfvhq\""
Sep 20 01:26:18.304278 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.304258    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"]
Sep 20 01:26:18.388905 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.388865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7aabb5f4-89a7-47f2-b3b1-242423aa1e28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zldbc\" (UID: \"7aabb5f4-89a7-47f2-b3b1-242423aa1e28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.389124 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.388947    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxqs\" (UniqueName: \"kubernetes.io/projected/7aabb5f4-89a7-47f2-b3b1-242423aa1e28-kube-api-access-nlxqs\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zldbc\" (UID: \"7aabb5f4-89a7-47f2-b3b1-242423aa1e28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.491954 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.489848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7aabb5f4-89a7-47f2-b3b1-242423aa1e28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zldbc\" (UID: \"7aabb5f4-89a7-47f2-b3b1-242423aa1e28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.491954 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.490013    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxqs\" (UniqueName: \"kubernetes.io/projected/7aabb5f4-89a7-47f2-b3b1-242423aa1e28-kube-api-access-nlxqs\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zldbc\" (UID: \"7aabb5f4-89a7-47f2-b3b1-242423aa1e28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.491954 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.490939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7aabb5f4-89a7-47f2-b3b1-242423aa1e28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zldbc\" (UID: \"7aabb5f4-89a7-47f2-b3b1-242423aa1e28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.499284 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.499257    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxqs\" (UniqueName: \"kubernetes.io/projected/7aabb5f4-89a7-47f2-b3b1-242423aa1e28-kube-api-access-nlxqs\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zldbc\" (UID: \"7aabb5f4-89a7-47f2-b3b1-242423aa1e28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.604628 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.604540    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:18.880402 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:18.880374    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"]
Sep 20 01:26:18.883328 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:26:18.883305    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aabb5f4_89a7_47f2_b3b1_242423aa1e28.slice/crio-897221806f2393edf8b94f567d069925eff1c00f629aa78218f44c6cd79222bd WatchSource:0}: Error finding container 897221806f2393edf8b94f567d069925eff1c00f629aa78218f44c6cd79222bd: Status 404 returned error can't find the container with id 897221806f2393edf8b94f567d069925eff1c00f629aa78218f44c6cd79222bd
Sep 20 01:26:19.536593 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:19.536557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc" event={"ID":"7aabb5f4-89a7-47f2-b3b1-242423aa1e28","Type":"ContainerStarted","Data":"550fdf51c470957cc93a80fcd044f0aae780969bcb3430f0decb545168409fc9"}
Sep 20 01:26:19.537046 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:19.536609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc" event={"ID":"7aabb5f4-89a7-47f2-b3b1-242423aa1e28","Type":"ContainerStarted","Data":"897221806f2393edf8b94f567d069925eff1c00f629aa78218f44c6cd79222bd"}
Sep 20 01:26:19.537046 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:19.536717    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:26:19.556022 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:19.555962    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc" podStartSLOduration=1.555943018 podStartE2EDuration="1.555943018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:26:19.554288782 +0000 UTC m=+2335.803790586" watchObservedRunningTime="2026-09-20 01:26:19.555943018 +0000 UTC m=+2335.805444821"
Sep 20 01:26:30.544629 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:26:30.544598    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zldbc"
Sep 20 01:27:26.245506 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:26.245471    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:27:26.266369 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:26.266345    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:27:51.335419 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.335341    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"]
Sep 20 01:27:51.335770 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.335757    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager"
Sep 20 01:27:51.335770 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.335768    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7551ec-27ab-43e5-a675-c627df0bf4b4" containerName="manager"
Sep 20 01:27:51.339179 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.339152    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.361106 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.361078    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"]
Sep 20 01:27:51.526559 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.526525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbz9j\" (UniqueName: \"kubernetes.io/projected/4f945b5e-772c-430d-acb3-c65234aecc8e-kube-api-access-kbz9j\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.526559 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.526572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f945b5e-772c-430d-acb3-c65234aecc8e-metrics-certs\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.526794 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.526641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f945b5e-772c-430d-acb3-c65234aecc8e-maas-api-tls\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.526794 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.526728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f945b5e-772c-430d-acb3-c65234aecc8e-openshift-service-ca\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.627313 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.627213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f945b5e-772c-430d-acb3-c65234aecc8e-maas-api-tls\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.627313 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.627311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f945b5e-772c-430d-acb3-c65234aecc8e-openshift-service-ca\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.627566 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.627361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbz9j\" (UniqueName: \"kubernetes.io/projected/4f945b5e-772c-430d-acb3-c65234aecc8e-kube-api-access-kbz9j\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.627566 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.627402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f945b5e-772c-430d-acb3-c65234aecc8e-metrics-certs\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.628035 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.628010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f945b5e-772c-430d-acb3-c65234aecc8e-openshift-service-ca\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.629761 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.629734    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f945b5e-772c-430d-acb3-c65234aecc8e-maas-api-tls\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.629850 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.629816    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f945b5e-772c-430d-acb3-c65234aecc8e-metrics-certs\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.634407 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.634387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbz9j\" (UniqueName: \"kubernetes.io/projected/4f945b5e-772c-430d-acb3-c65234aecc8e-kube-api-access-kbz9j\") pod \"maas-api-8469986cd6-rqdpm\" (UID: \"4f945b5e-772c-430d-acb3-c65234aecc8e\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.651267 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.651244    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:51.923752 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:51.923726    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"]
Sep 20 01:27:51.925017 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:27:51.924993    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f945b5e_772c_430d_acb3_c65234aecc8e.slice/crio-3d346e738708aa1b6798ca7592bcbb00f649d7260e1c9a74ac7470e53ba34819 WatchSource:0}: Error finding container 3d346e738708aa1b6798ca7592bcbb00f649d7260e1c9a74ac7470e53ba34819: Status 404 returned error can't find the container with id 3d346e738708aa1b6798ca7592bcbb00f649d7260e1c9a74ac7470e53ba34819
Sep 20 01:27:52.071778 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:52.071737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm" event={"ID":"4f945b5e-772c-430d-acb3-c65234aecc8e","Type":"ContainerStarted","Data":"3d346e738708aa1b6798ca7592bcbb00f649d7260e1c9a74ac7470e53ba34819"}
Sep 20 01:27:53.079519 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:53.079474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm" event={"ID":"4f945b5e-772c-430d-acb3-c65234aecc8e","Type":"ContainerStarted","Data":"68dda82a3988a48029be010d20d8213d26abd415b53e782b259791d67c44e5bb"}
Sep 20 01:27:53.079877 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:53.079545    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:27:53.098382 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:53.098335    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm" podStartSLOduration=1.738159629 podStartE2EDuration="2.098317546s" totalImagesPullingTime="360.157917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:27:53.096436033 +0000 UTC m=+2429.345937841" watchObservedRunningTime="2026-09-20 01:27:53.098317546 +0000 UTC m=+2429.347819375"
Sep 20 01:27:59.090521 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:27:59.090486    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8469986cd6-rqdpm"
Sep 20 01:28:06.940533 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:06.940488    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"]
Sep 20 01:28:06.941123 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:06.940753    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" podUID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" containerName="maas-api" containerID="cri-o://647f52c1359aa8ed9b39982db24462469a149e7f9aadf9da7ef8615414243747" gracePeriod=30
Sep 20 01:28:07.209999 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:07.209887    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" podUID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.54:8443/health\": dial tcp 10.132.0.54:8443: connect: connection refused"
Sep 20 01:28:08.167776 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.167750    2568 generic.go:356] "Generic (PLEG): container finished" podID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" containerID="647f52c1359aa8ed9b39982db24462469a149e7f9aadf9da7ef8615414243747" exitCode=0
Sep 20 01:28:08.168121 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.167817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" event={"ID":"14af6416-6bd5-4daa-b162-fd71f0ee7c33","Type":"ContainerDied","Data":"647f52c1359aa8ed9b39982db24462469a149e7f9aadf9da7ef8615414243747"}
Sep 20 01:28:08.187713 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.187690    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 01:28:08.264811 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.264780    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-maas-api-tls\") pod \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") "
Sep 20 01:28:08.264811 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.264815    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgr8l\" (UniqueName: \"kubernetes.io/projected/14af6416-6bd5-4daa-b162-fd71f0ee7c33-kube-api-access-qgr8l\") pod \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") "
Sep 20 01:28:08.265102 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.264855    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14af6416-6bd5-4daa-b162-fd71f0ee7c33-openshift-service-ca\") pod \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") "
Sep 20 01:28:08.265102 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.264907    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-metrics-certs\") pod \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\" (UID: \"14af6416-6bd5-4daa-b162-fd71f0ee7c33\") "
Sep 20 01:28:08.265284 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.265257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14af6416-6bd5-4daa-b162-fd71f0ee7c33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14af6416-6bd5-4daa-b162-fd71f0ee7c33" (UID: "14af6416-6bd5-4daa-b162-fd71f0ee7c33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:28:08.267162 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.267101    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "14af6416-6bd5-4daa-b162-fd71f0ee7c33" (UID: "14af6416-6bd5-4daa-b162-fd71f0ee7c33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:28:08.267162 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.267124    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14af6416-6bd5-4daa-b162-fd71f0ee7c33-kube-api-access-qgr8l" (OuterVolumeSpecName: "kube-api-access-qgr8l") pod "14af6416-6bd5-4daa-b162-fd71f0ee7c33" (UID: "14af6416-6bd5-4daa-b162-fd71f0ee7c33"). InnerVolumeSpecName "kube-api-access-qgr8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:28:08.267162 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.267120    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14af6416-6bd5-4daa-b162-fd71f0ee7c33" (UID: "14af6416-6bd5-4daa-b162-fd71f0ee7c33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:28:08.366090 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.366055    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-maas-api-tls\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:28:08.366090 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.366085    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgr8l\" (UniqueName: \"kubernetes.io/projected/14af6416-6bd5-4daa-b162-fd71f0ee7c33-kube-api-access-qgr8l\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:28:08.366090 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.366095    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14af6416-6bd5-4daa-b162-fd71f0ee7c33-openshift-service-ca\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:28:08.366326 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:08.366103    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14af6416-6bd5-4daa-b162-fd71f0ee7c33-metrics-certs\") on node \"ip-10-0-141-21.ec2.internal\" DevicePath \"\""
Sep 20 01:28:09.174904 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:09.174875    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"
Sep 20 01:28:09.175331 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:09.174912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b" event={"ID":"14af6416-6bd5-4daa-b162-fd71f0ee7c33","Type":"ContainerDied","Data":"aadc8556efcf7d881e91781db74fb3f536c0d9ff63aa4aeb0f768569d3a4db53"}
Sep 20 01:28:09.175331 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:09.174979    2568 scope.go:117] "RemoveContainer" containerID="647f52c1359aa8ed9b39982db24462469a149e7f9aadf9da7ef8615414243747"
Sep 20 01:28:09.194746 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:09.194725    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"]
Sep 20 01:28:09.197062 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:09.197042    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-2wq6b"]
Sep 20 01:28:09.987924 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:09.987883    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" path="/var/lib/kubelet/pods/14af6416-6bd5-4daa-b162-fd71f0ee7c33/volumes"
Sep 20 01:28:29.259212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:29.259180    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bbffp_743979c6-e237-488e-9826-2b5238573f67/manager/0.log"
Sep 20 01:28:29.372859 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:29.372828    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rmkj4_12bd30e8-9ec1-40e4-a219-e55f4c6eb123/manager/0.log"
Sep 20 01:28:29.493554 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:29.493524    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5df4664d44-9cqj2_eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998/manager/0.log"
Sep 20 01:28:29.980648 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:29.980611    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-4lltx_c869858f-8d52-43b0-8241-3d5d4ca0a759/manager/0.log"
Sep 20 01:28:29.985521 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:29.985498    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-4lltx_c869858f-8d52-43b0-8241-3d5d4ca0a759/copy-manifests/0.log"
Sep 20 01:28:30.435157 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:30.435125    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8469986cd6-rqdpm_4f945b5e-772c-430d-acb3-c65234aecc8e/maas-api/0.log"
Sep 20 01:28:30.869059 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:30.868953    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mltdd_a6c480fa-3861-4541-8e60-d2f449939248/postgres/0.log"
Sep 20 01:28:31.762743 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:31.762705    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kk8dm_5ad82315-76c7-40fe-8a82-bca9a5b1f185/manager/0.log"
Sep 20 01:28:31.874354 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:31.874323    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-klgcg_5445eae0-5430-469f-9efd-9868daf6bc41/manager/0.log"
Sep 20 01:28:31.985348 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:31.985321    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6ls25_32cb371a-6f44-413e-81a5-bb61ab97d41e/kuadrant-console-plugin/0.log"
Sep 20 01:28:32.112890 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:32.112815    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-zldbc_7aabb5f4-89a7-47f2-b3b1-242423aa1e28/manager/0.log"
Sep 20 01:28:32.375807 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:32.375733    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-dxrlj_43445d31-f5d2-4753-99df-a053ef1f0405/manager/0.log"
Sep 20 01:28:33.071876 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:33.071845    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-xknf2_b7272d4a-c0ce-46d4-a3bf-0181fb356cfe/kube-auth-proxy/0.log"
Sep 20 01:28:33.549373 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:33.549343    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f877b5d76-g48vt_a5111e83-a1f2-4f30-9cd5-4e661710dfa6/router/0.log"
Sep 20 01:28:33.895851 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:33.895772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-h8hhk_44785001-bbb8-40bc-a00c-e2a264847de6/main/0.log"
Sep 20 01:28:34.225824 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:34.225792    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-g6s4t_99179556-fa32-4f28-b101-f6f7612126ef/main/0.log"
Sep 20 01:28:34.438809 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:34.438778    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ckfp9_9d4344f3-3470-4c09-90ce-dcb7b71c4d33/main/0.log"
Sep 20 01:28:40.025510 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.025469    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjfsx/must-gather-njhcq"]
Sep 20 01:28:40.027904 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.026017    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" containerName="maas-api"
Sep 20 01:28:40.027904 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.026038    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" containerName="maas-api"
Sep 20 01:28:40.027904 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.026170    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="14af6416-6bd5-4daa-b162-fd71f0ee7c33" containerName="maas-api"
Sep 20 01:28:40.029180 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.029160    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.031502 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.031476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjfsx\"/\"openshift-service-ca.crt\""
Sep 20 01:28:40.032107 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.032086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjfsx\"/\"default-dockercfg-lzs5j\""
Sep 20 01:28:40.032190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.032103    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjfsx\"/\"kube-root-ca.crt\""
Sep 20 01:28:40.037796 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.037775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/must-gather-njhcq"]
Sep 20 01:28:40.158898 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.158862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbttj\" (UniqueName: \"kubernetes.io/projected/ed569861-a35c-4d2d-a886-9628e2e21c19-kube-api-access-xbttj\") pod \"must-gather-njhcq\" (UID: \"ed569861-a35c-4d2d-a886-9628e2e21c19\") " pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.159089 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.158903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ed569861-a35c-4d2d-a886-9628e2e21c19-must-gather-output\") pod \"must-gather-njhcq\" (UID: \"ed569861-a35c-4d2d-a886-9628e2e21c19\") " pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.259803 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.259763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbttj\" (UniqueName: \"kubernetes.io/projected/ed569861-a35c-4d2d-a886-9628e2e21c19-kube-api-access-xbttj\") pod \"must-gather-njhcq\" (UID: \"ed569861-a35c-4d2d-a886-9628e2e21c19\") " pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.259803 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.259807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ed569861-a35c-4d2d-a886-9628e2e21c19-must-gather-output\") pod \"must-gather-njhcq\" (UID: \"ed569861-a35c-4d2d-a886-9628e2e21c19\") " pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.260231 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.260208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ed569861-a35c-4d2d-a886-9628e2e21c19-must-gather-output\") pod \"must-gather-njhcq\" (UID: \"ed569861-a35c-4d2d-a886-9628e2e21c19\") " pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.267518 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.267489    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbttj\" (UniqueName: \"kubernetes.io/projected/ed569861-a35c-4d2d-a886-9628e2e21c19-kube-api-access-xbttj\") pod \"must-gather-njhcq\" (UID: \"ed569861-a35c-4d2d-a886-9628e2e21c19\") " pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.339753 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.339661    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/must-gather-njhcq"
Sep 20 01:28:40.624642 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.624617    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/must-gather-njhcq"]
Sep 20 01:28:40.626253 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:28:40.626222    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded569861_a35c_4d2d_a886_9628e2e21c19.slice/crio-bdeb140f00c7ac2f4feb70b67b93d54a4d6e81340d43a212d93ea9042da815a4 WatchSource:0}: Error finding container bdeb140f00c7ac2f4feb70b67b93d54a4d6e81340d43a212d93ea9042da815a4: Status 404 returned error can't find the container with id bdeb140f00c7ac2f4feb70b67b93d54a4d6e81340d43a212d93ea9042da815a4
Sep 20 01:28:40.628214 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:40.628197    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:28:41.362121 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:41.362085    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/must-gather-njhcq" event={"ID":"ed569861-a35c-4d2d-a886-9628e2e21c19","Type":"ContainerStarted","Data":"bdeb140f00c7ac2f4feb70b67b93d54a4d6e81340d43a212d93ea9042da815a4"}
Sep 20 01:28:42.372341 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:42.372302    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/must-gather-njhcq" event={"ID":"ed569861-a35c-4d2d-a886-9628e2e21c19","Type":"ContainerStarted","Data":"0dfd899418f9547f228954c6d84a7831f538dd2301ee868cca0508bc69e232a3"}
Sep 20 01:28:42.372341 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:42.372361    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/must-gather-njhcq" event={"ID":"ed569861-a35c-4d2d-a886-9628e2e21c19","Type":"ContainerStarted","Data":"257a4d4d335fb7700a5cd66235a3d66189a2f98810467d4d0c91c3dd1ee0c011"}
Sep 20 01:28:42.386167 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:42.386105    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjfsx/must-gather-njhcq" podStartSLOduration=1.620843078 podStartE2EDuration="2.386086319s" totalImagesPullingTime="765.243241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:28:42.38589014 +0000 UTC m=+2478.635391968" watchObservedRunningTime="2026-09-20 01:28:42.386086319 +0000 UTC m=+2478.635588124"
Sep 20 01:28:43.011614 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:43.011581    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n742d_ca261dfa-0300-498b-9f0e-f21d394d8ee6/global-pull-secret-syncer/0.log"
Sep 20 01:28:43.135282 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:43.135247    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mkbhg_016f3c6f-c12c-402e-8e8d-cdbc5e33c8fd/konnectivity-agent/0.log"
Sep 20 01:28:43.232412 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:43.232365    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-21.ec2.internal_458cc5e4d409fd46cbba485eb0da8653/haproxy/0.log"
Sep 20 01:28:47.565869 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:47.565828    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kk8dm_5ad82315-76c7-40fe-8a82-bca9a5b1f185/manager/0.log"
Sep 20 01:28:47.596801 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:47.596759    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-klgcg_5445eae0-5430-469f-9efd-9868daf6bc41/manager/0.log"
Sep 20 01:28:47.637338 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:47.637306    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6ls25_32cb371a-6f44-413e-81a5-bb61ab97d41e/kuadrant-console-plugin/0.log"
Sep 20 01:28:47.684627 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:47.684592    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-zldbc_7aabb5f4-89a7-47f2-b3b1-242423aa1e28/manager/0.log"
Sep 20 01:28:47.775968 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:47.775905    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-dxrlj_43445d31-f5d2-4753-99df-a053ef1f0405/manager/0.log"
Sep 20 01:28:49.504216 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:49.504164    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-bvcrb_658d8f90-8dda-48c4-82d7-397dfd77d262/cluster-monitoring-operator/0.log"
Sep 20 01:28:49.619130 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:49.619092    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-l97ls_1c6fca46-59dd-4dff-b84a-abfac77bcd4c/monitoring-plugin/0.log"
Sep 20 01:28:49.797519 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:49.797450    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxmkl_afa029d0-d6a2-439c-968f-93d3a154542d/node-exporter/0.log"
Sep 20 01:28:49.819730 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:49.819706    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxmkl_afa029d0-d6a2-439c-968f-93d3a154542d/kube-rbac-proxy/0.log"
Sep 20 01:28:49.840514 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:49.840424    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxmkl_afa029d0-d6a2-439c-968f-93d3a154542d/init-textfile/0.log"
Sep 20 01:28:52.715715 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:52.715687    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/1.log"
Sep 20 01:28:52.731334 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:52.731291    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zb4cn_c608f222-85e5-4d66-9612-43cda7de1b31/console-operator/2.log"
Sep 20 01:28:53.342352 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.342308    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"]
Sep 20 01:28:53.349013 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.348982    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.355828 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.355789    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"]
Sep 20 01:28:53.401592 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.401551    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-sys\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.401753 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.401610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrhcf\" (UniqueName: \"kubernetes.io/projected/d5cd8212-6593-4221-957a-f2f7729b81e2-kube-api-access-wrhcf\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.401753 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.401676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-proc\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.401753 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.401723    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-lib-modules\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.401864 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.401824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-podres\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.502701 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.502655    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-lib-modules\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.502891 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.502737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-podres\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.502891 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.502802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-sys\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.502891 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.502834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrhcf\" (UniqueName: \"kubernetes.io/projected/d5cd8212-6593-4221-957a-f2f7729b81e2-kube-api-access-wrhcf\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.502891 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.502870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-proc\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.503141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.502993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-proc\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.503141 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.503117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-lib-modules\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.503247 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.503189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-podres\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.503247 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.503234    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5cd8212-6593-4221-957a-f2f7729b81e2-sys\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.513415 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.513379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrhcf\" (UniqueName: \"kubernetes.io/projected/d5cd8212-6593-4221-957a-f2f7729b81e2-kube-api-access-wrhcf\") pod \"perf-node-gather-daemonset-4bs4x\" (UID: \"d5cd8212-6593-4221-957a-f2f7729b81e2\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.664193 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.664107    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:53.967646 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:53.967614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"]
Sep 20 01:28:53.969410 ip-10-0-141-21 kubenswrapper[2568]: W0920 01:28:53.969376    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd5cd8212_6593_4221_957a_f2f7729b81e2.slice/crio-d83269f9f7770322cdd486d772f9313b407bae0f6305b69bdae7504f9b12100b WatchSource:0}: Error finding container d83269f9f7770322cdd486d772f9313b407bae0f6305b69bdae7504f9b12100b: Status 404 returned error can't find the container with id d83269f9f7770322cdd486d772f9313b407bae0f6305b69bdae7504f9b12100b
Sep 20 01:28:54.078045 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:54.078007    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-5j9rq_5ac18d02-6b0f-4f16-854f-103b60357b0b/volume-data-source-validator/0.log"
Sep 20 01:28:54.484212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:54.483215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x" event={"ID":"d5cd8212-6593-4221-957a-f2f7729b81e2","Type":"ContainerStarted","Data":"366b1c403f2e697011056250bda66e092f41166e16263529ed364f2294e75a03"}
Sep 20 01:28:54.484212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:54.483287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x" event={"ID":"d5cd8212-6593-4221-957a-f2f7729b81e2","Type":"ContainerStarted","Data":"d83269f9f7770322cdd486d772f9313b407bae0f6305b69bdae7504f9b12100b"}
Sep 20 01:28:54.484212 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:54.484148    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:28:54.500732 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:54.500679    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x" podStartSLOduration=1.5006616130000001 podStartE2EDuration="1.500661613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:28:54.498196717 +0000 UTC m=+2490.747698521" watchObservedRunningTime="2026-09-20 01:28:54.500661613 +0000 UTC m=+2490.750163433"
Sep 20 01:28:55.255778 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:55.255742    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6p6f6_0cfec327-8405-465e-8afb-e10959dfe4be/dns/0.log"
Sep 20 01:28:55.276610 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:55.276586    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6p6f6_0cfec327-8405-465e-8afb-e10959dfe4be/kube-rbac-proxy/0.log"
Sep 20 01:28:55.439137 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:55.439107    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssbd8_5842520d-6796-4145-b3d2-ccc7bd40ea0e/dns-node-resolver/0.log"
Sep 20 01:28:56.080190 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:56.080155    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rxsh4_caa30d1a-b31f-4f19-9b7e-ae21ab457b0e/node-ca/0.log"
Sep 20 01:28:57.522063 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:57.522036    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-xknf2_b7272d4a-c0ce-46d4-a3bf-0181fb356cfe/kube-auth-proxy/0.log"
Sep 20 01:28:57.637942 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:57.637885    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f877b5d76-g48vt_a5111e83-a1f2-4f30-9cd5-4e661710dfa6/router/0.log"
Sep 20 01:28:58.547205 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:58.547176    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwwdz_2a87d3b0-8e92-4273-a582-d734c67c8c18/serve-healthcheck-canary/0.log"
Sep 20 01:28:58.999178 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:58.999126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-d6bg5_1e37bb20-cc8d-43c8-9638-2546fc676ce4/insights-operator/0.log"
Sep 20 01:28:59.001714 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:59.001687    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-d6bg5_1e37bb20-cc8d-43c8-9638-2546fc676ce4/insights-operator/1.log"
Sep 20 01:28:59.086526 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:59.086497    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9lqmf_8f675bec-fcea-4e2c-a7fe-dfd286c1e166/kube-rbac-proxy/0.log"
Sep 20 01:28:59.107639 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:59.107597    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9lqmf_8f675bec-fcea-4e2c-a7fe-dfd286c1e166/exporter/0.log"
Sep 20 01:28:59.128554 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:28:59.128516    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9lqmf_8f675bec-fcea-4e2c-a7fe-dfd286c1e166/extractor/0.log"
Sep 20 01:29:01.267115 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:01.267083    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bbffp_743979c6-e237-488e-9826-2b5238573f67/manager/0.log"
Sep 20 01:29:01.512698 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:01.512671    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-4bs4x"
Sep 20 01:29:01.642677 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:01.641853    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rmkj4_12bd30e8-9ec1-40e4-a219-e55f4c6eb123/manager/0.log"
Sep 20 01:29:01.701652 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:01.701608    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5df4664d44-9cqj2_eca7f3bc-ecd4-4332-ad08-4bbc9cbe1998/manager/0.log"
Sep 20 01:29:01.872864 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:01.872822    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-4lltx_c869858f-8d52-43b0-8241-3d5d4ca0a759/manager/0.log"
Sep 20 01:29:01.892289 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:01.892262    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-4lltx_c869858f-8d52-43b0-8241-3d5d4ca0a759/copy-manifests/0.log"
Sep 20 01:29:04.203691 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:04.203655    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-xknf2_b7272d4a-c0ce-46d4-a3bf-0181fb356cfe/kube-auth-proxy/0.log"
Sep 20 01:29:04.287147 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:04.287076    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f877b5d76-g48vt_a5111e83-a1f2-4f30-9cd5-4e661710dfa6/router/0.log"
Sep 20 01:29:06.377083 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:06.377056    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-xknf2_b7272d4a-c0ce-46d4-a3bf-0181fb356cfe/kube-auth-proxy/0.log"
Sep 20 01:29:06.465886 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:06.465832    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f877b5d76-g48vt_a5111e83-a1f2-4f30-9cd5-4e661710dfa6/router/0.log"
Sep 20 01:29:09.064265 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:09.064191    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-4ptkx_de73791e-b2cd-4357-a667-0f5dfe3032fa/kube-storage-version-migrator-operator/1.log"
Sep 20 01:29:09.065157 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:09.065138    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-4ptkx_de73791e-b2cd-4357-a667-0f5dfe3032fa/kube-storage-version-migrator-operator/0.log"
Sep 20 01:29:10.050339 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.050295    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-94cqs_b3c1f85c-1208-4641-83df-379c226d0c74/kube-multus/0.log"
Sep 20 01:29:10.360843 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.360765    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/kube-multus-additional-cni-plugins/0.log"
Sep 20 01:29:10.380196 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.380175    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/egress-router-binary-copy/0.log"
Sep 20 01:29:10.399005 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.398985    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/cni-plugins/0.log"
Sep 20 01:29:10.418097 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.418067    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/bond-cni-plugin/0.log"
Sep 20 01:29:10.437339 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.437317    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/routeoverride-cni/0.log"
Sep 20 01:29:10.457313 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.457291    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/whereabouts-cni-bincopy/0.log"
Sep 20 01:29:10.475661 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.475640    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lq5zs_0dbb192c-cf1d-485b-8777-72ee430191fe/whereabouts-cni/0.log"
Sep 20 01:29:10.657568 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.657492    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nph9k_bafb2e84-f0f7-499d-a96f-8385327a0b63/network-metrics-daemon/0.log"
Sep 20 01:29:10.676366 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:10.676337    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nph9k_bafb2e84-f0f7-499d-a96f-8385327a0b63/kube-rbac-proxy/0.log"
Sep 20 01:29:11.878783 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.878754    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/ovn-controller/0.log"
Sep 20 01:29:11.893294 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.893273    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/ovn-acl-logging/0.log"
Sep 20 01:29:11.915184 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.915157    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/kube-rbac-proxy-node/0.log"
Sep 20 01:29:11.934814 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.934789    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/kube-rbac-proxy-ovn-metrics/0.log"
Sep 20 01:29:11.953667 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.953645    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/northd/0.log"
Sep 20 01:29:11.974013 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.973984    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/nbdb/0.log"
Sep 20 01:29:11.993549 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:11.993528    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/sbdb/0.log"
Sep 20 01:29:12.058007 ip-10-0-141-21 kubenswrapper[2568]: I0920 01:29:12.057934    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzzzj_3aeee648-94b7-4808-9dda-aaaf9d728251/ovnkube-controller/0.log"