Sep 10 11:14:35.789859 ip-10-0-128-153 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 11:14:36.173189 ip-10-0-128-153 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 11:14:36.173189 ip-10-0-128-153 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 11:14:36.173189 ip-10-0-128-153 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 11:14:36.173189 ip-10-0-128-153 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 11:14:36.173189 ip-10-0-128-153 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 11:14:36.174275 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.174196    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 11:14:36.179184 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179169    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 11:14:36.179184 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179185    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179189    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179192    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179195    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179198    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179200    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179204    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179206    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179209    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179212    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179215    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179217    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179220    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179223    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179225    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179228    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179236    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179239    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179241    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179244    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 11:14:36.179249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179246    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179249    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179252    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179254    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179257    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179260    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179264    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179268    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179271    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179274    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179277    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179280    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179283    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179285    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179288    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179290    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179293    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179295    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179298    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179300    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 11:14:36.179748 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179303    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179305    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179307    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179310    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179312    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179314    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179317    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179319    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179322    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179325    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179327    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179330    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179332    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179337    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179341    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179344    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179347    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179350    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179353    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179356    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 11:14:36.180272 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179358    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179361    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179365    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179368    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179370    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179373    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179376    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179378    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179381    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179384    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179387    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179389    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179392    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179394    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179397    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179399    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179401    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179404    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179406    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179409    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 11:14:36.180773 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179411    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179414    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179417    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179420    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179423    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179426    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179429    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179433    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179435    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179438    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179440    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179443    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179446    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179450    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179453    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179456    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179459    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.179462    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180165    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 11:14:36.181295 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180172    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180176    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180179    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180181    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180184    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180187    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180189    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180192    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180194    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180197    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180199    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180202    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180204    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180207    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180209    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180212    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180215    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180218    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180222    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180226    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 11:14:36.181770 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180229    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180232    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180235    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180237    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180240    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180243    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180245    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180248    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180250    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180253    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180255    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180258    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180261    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180263    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180266    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180268    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180271    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180273    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180276    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180279    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 11:14:36.182258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180281    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180284    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180287    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180289    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180292    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180294    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180296    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180299    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180302    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180305    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180308    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180311    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180313    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180316    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180318    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180321    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180323    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180326    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180328    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 11:14:36.182825 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180332    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180334    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180337    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180339    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180343    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180347    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180350    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180353    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180355    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180358    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180361    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180364    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180366    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180369    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180371    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180374    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180377    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180380    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180382    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 11:14:36.183372 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180385    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180388    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180390    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180394    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180398    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180401    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180404    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180408    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180411    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180413    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180417    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180419    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180422    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180424    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180427    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180429    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180432    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180434    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180436    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180439    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 11:14:36.183929 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180795    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180800    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180803    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180806    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180809    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180811    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180814    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180817    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180819    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180822    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180824    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180827    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180829    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180833    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180835    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180838    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180841    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180844    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180847    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 11:14:36.184506 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180849    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180852    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180854    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180857    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180860    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180863    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180865    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180867    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180870    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180872    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180875    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180877    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180880    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180882    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180885    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180887    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180890    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180894    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180897    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180900    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 11:14:36.185057 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180902    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180904    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180908    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180910    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180913    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180915    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180919    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180922    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180925    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180927    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180930    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180933    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180936    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180938    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180941    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180943    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180946    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180948    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180951    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 11:14:36.185634 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180953    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180957    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180960    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180963    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180965    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180968    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180983    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180986    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180988    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180992    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180996    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.180999    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181002    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181004    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181007    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181010    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181012    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181015    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181017    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 11:14:36.186132 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181023    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181026    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181030    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181033    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181036    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181046    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181049    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181052    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181055    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181058    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181060    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181063    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181065    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181068    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181071    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181073    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181076    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181079    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181081    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181084    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 11:14:36.186628 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181086    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181089    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181161    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181193    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181199    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181204    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181208    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181211    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181215    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181219    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181222    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181225    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181230    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181233    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181239    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181242    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181245    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181248    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181251    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181254    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181258    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181261    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181264    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181267    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 11:14:36.187107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181271    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181274    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181277    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181280    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181283    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181286    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181290    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181293    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181296    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181299    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181303    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181306    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181309    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181312    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181315    2580 flags.go:64] FLAG: --enable-server="true"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181318    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181321    2580 flags.go:64] FLAG: --event-burst="100"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181325    2580 flags.go:64] FLAG: --event-qps="50"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181327    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181334    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181338    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181342    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181347    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181350    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181352    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 10 11:14:36.187807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181355    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181358    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181361    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181364    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181367    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181370    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181373    2580 flags.go:64] FLAG: --feature-gates=""
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181377    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181379    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181382    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181385    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181388    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181391    2580 flags.go:64] FLAG: --help="false"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181394    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181397    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181399    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181402    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181405    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181408    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181411    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181414    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181416    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181419    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 11:14:36.188442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181422    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181425    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181428    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181430    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181434    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181437    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181444    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181447    2580 flags.go:64] FLAG: --lock-file=""
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181450    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181452    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181455    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181461    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181464    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181467    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181469    2580 flags.go:64] FLAG: --logging-format="text"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181472    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181476    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181478    2580 flags.go:64] FLAG: --manifest-url=""
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181481    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181485    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181488    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181492    2580 flags.go:64] FLAG: --max-pods="110"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181495    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181498    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181501    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 11:14:36.189399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181504    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181507    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181510    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181513    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181524    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181526    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181543    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181546    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181549    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181554    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181557    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181560    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181565    2580 flags.go:64] FLAG: --port="10250"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181569    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181572    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a04de0c1d7d8f1d3"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181575    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181578    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181581    2580 flags.go:64] FLAG: --register-node="true"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181583    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181587    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181590    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181593    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181596    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181599    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181603    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 11:14:36.190034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181605    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181608    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181611    2580 flags.go:64] FLAG: --runonce="false"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181614    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181617    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181620    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181622    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181625    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181628    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181631    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181634    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181636    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181639    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181642    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181644    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181647    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181650    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181653    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181658    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181663    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181667    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181671    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181674    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181676    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181679    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 11:14:36.190668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181682    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181684    2580 flags.go:64] FLAG: --v="2"
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181688    2580 flags.go:64] FLAG: --version="false"
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181693    2580 flags.go:64] FLAG: --vmodule=""
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181696    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.181700    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181807    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181811    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181815    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181817    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181820    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181823    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181826    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181828    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181831    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181834    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181836    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181840    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181844    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181847    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181850    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 11:14:36.191274 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181853    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181855    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181858    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181861    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181863    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181866    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181870    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181873    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181875    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181878    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181880    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181883    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181885    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181888    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181890    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181893    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181895    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181898    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181900    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181903    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 11:14:36.191810 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181906    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181908    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181911    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181915    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181918    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181921    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181923    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181926    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181929    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181931    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181934    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181936    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181947    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181949    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181952    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181954    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181957    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181960    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181964    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 11:14:36.192301 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181967    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181969    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181972    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181974    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181977    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181980    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181982    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181985    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181988    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181990    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181993    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.181996    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182000    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182003    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182006    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182008    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182011    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182014    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182016    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 11:14:36.192771 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182018    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182021    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182023    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182026    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182028    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182031    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182033    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182036    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182038    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182041    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182043    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182045    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182049    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182052    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182054    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182056    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182059    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182061    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182064    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182066    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 11:14:36.193249 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182069    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182071    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182074    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182077    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182079    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.182082    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.182565    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.190544    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.190558    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.191902    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.191914    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191969    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191974    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191977    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191980    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 11:14:36.193750 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191983    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191986    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191989    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191991    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191994    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.191997    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192000    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192004    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192007    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192010    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192013    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192016    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192020    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192024    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192027    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192030    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192032    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192035    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192037    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192040    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 11:14:36.194122 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192042    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192046    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192050    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192053    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192056    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192059    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192061    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192064    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192066    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192069    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192071    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192074    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192076    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192079    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192081    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192083    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192086    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192088    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192091    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 11:14:36.194618 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192093    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192096    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192099    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192102    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192105    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192107    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192110    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192112    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192115    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192117    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192119    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192122    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192124    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192127    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192129    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192132    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192135    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192137    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192139    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192142    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 11:14:36.195085 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192145    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192147    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192150    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192152    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192155    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192157    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192160    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192163    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192165    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192167    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192170    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192173    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192175    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192177    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192180    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192183    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192186    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192188    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192191    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 11:14:36.195582 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192193    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192196    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192198    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192201    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192204    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192206    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192209    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192211    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192214    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192216    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192218    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192221    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192223    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192226    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192228    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192231    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 11:14:36.196059 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192233    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.192238    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192341    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192346    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192349    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192352    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192355    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192358    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192360    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192363    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192365    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192368    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192371    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192374    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192379    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 11:14:36.196466 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192382    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192385    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192388    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192391    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192394    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192397    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192400    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192403    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192406    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192409    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192411    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192414    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192417    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192419    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192422    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192425    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192427    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192430    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192432    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 11:14:36.196847 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192435    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192437    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192440    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192442    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192445    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192448    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192450    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192453    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192456    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192460    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192463    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192465    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192468    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192472    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192474    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192477    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192479    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192481    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192484    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192486    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 11:14:36.197303 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192489    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192491    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192494    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192496    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192499    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192501    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192503    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192506    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192508    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192511    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192513    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192515    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192518    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192520    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192523    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192525    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192540    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192542    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192545    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192547    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 11:14:36.197909 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192552    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192555    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192557    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192560    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192562    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192565    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192568    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192570    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192573    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192576    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192578    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192580    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192583    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192585    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192588    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192590    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192593    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192595    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192598    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192600    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 11:14:36.198381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192602    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192605    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192607    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192610    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192612    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192615    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:36.192617    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.192622    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.192719    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.195688    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.196551    2580 server.go:1019] "Starting client certificate rotation"
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.196653    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 11:14:36.198878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.197437    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 11:14:36.199205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.199098    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 11:14:36.200247 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.200230    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 11:14:36.211048 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.211028    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 10 11:14:36.214391 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.214374    2580 log.go:25] "Validated CRI v1 image API"
Sep 10 11:14:36.215291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.215267    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 11:14:36.218525 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.218504    2580 fs.go:135] Filesystem UUIDs: map[31ce4538-8eda-44d2-888b-cbf2e0c2e87d:/dev/nvme0n1p4 63523aab-e44e-476c-b4fe-31abba2a15a1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 10 11:14:36.218598 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.218527    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 11:14:36.225071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.224958    2580 manager.go:216] Machine: {Timestamp:2026-09-10 11:14:36.223627502 +0000 UTC m=+0.317829153 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104393 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27ba98727206b5fe8eb62f4834acff SystemUUID:ec27ba98-7272-06b5-fe8e-b62f4834acff BootID:4dd403a7-5d95-4c93-aa79-f5c0d5c11cb0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:93:9f:e0:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:93:9f:e0:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:2b:41:52:23:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 11:14:36.225071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.225060    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 11:14:36.225201 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.225141    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 11:14:36.227653 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.227626    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 11:14:36.227789 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.227654    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 11:14:36.228250 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.228227    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 11:14:36.228820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.228807    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 11:14:36.228887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.228826    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 11:14:36.228887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.228836    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 11:14:36.229805 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.229793    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 11:14:36.231032 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.231019    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 11:14:36.234601 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234587    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 11:14:36.234737 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234726    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 11:14:36.234794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234763    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 11:14:36.234794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234777    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 11:14:36.234794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234791    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 11:14:36.234912 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234805    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 10 11:14:36.234912 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.234816    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 11:14:36.235186 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.235172    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 11:14:36.235246 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.235197    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 11:14:36.237729 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.237714    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 11:14:36.239900 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.239885    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 11:14:36.239956 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.239915    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 11:14:36.240069 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240058    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 11:14:36.240107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240076    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 11:14:36.240107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240082    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 11:14:36.240107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240091    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 11:14:36.240107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240101    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 11:14:36.240229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240108    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 11:14:36.240630 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240619    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 11:14:36.240630 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240630    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 11:14:36.240701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240637    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 11:14:36.240701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240643    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 11:14:36.240701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240659    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 11:14:36.240701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.240667    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 11:14:36.241476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.241467    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 11:14:36.241476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.241477    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 11:14:36.245291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.245276    2580 server.go:1268] "Started kubelet"
Sep 10 11:14:36.245843 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.245350    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 11:14:36.246000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.245857    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 11:14:36.246322 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.246293    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 11:14:36.246361 ip-10-0-128-153 systemd[1]: Started Kubernetes Kubelet.
Sep 10 11:14:36.247011 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.246991    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 11:14:36.248279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.248103    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 11:14:36.248369 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.248296    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 11:14:36.248594 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.248562    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 11:14:36.248688 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.248628    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 11:14:36.250459 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.250433    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 11:14:36.251047 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.251034    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 11:14:36.251098 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.251051    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 11:14:36.251224 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.251187    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.251942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.251923    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 11:14:36.252036 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252024    2580 factory.go:55] Registering systemd factory
Sep 10 11:14:36.252036 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252036    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 10 11:14:36.252156 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252141    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 11:14:36.252218 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252157    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 11:14:36.252308 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252271    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 11:14:36.252308 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252282    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 11:14:36.252308 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252276    2580 factory.go:153] Registering CRI-O factory
Sep 10 11:14:36.252308 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252299    2580 factory.go:223] Registration of the crio container factory successfully
Sep 10 11:14:36.252483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252351    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 11:14:36.252483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252371    2580 factory.go:103] Registering Raw factory
Sep 10 11:14:36.252483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252393    2580 manager.go:1196] Started watching for new ooms in manager
Sep 10 11:14:36.252808 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.252794    2580 manager.go:349] Starting recovery of all containers
Sep 10 11:14:36.256140 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.256093    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 11:14:36.256805 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.256776    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 11:14:36.260137 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.256890    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-153.ec2.internal.18d3f16113f64c60  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-153.ec2.internal,UID:ip-10-0-128-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-153.ec2.internal,},FirstTimestamp:2026-09-10 11:14:36.24524912 +0000 UTC m=+0.339450771,LastTimestamp:2026-09-10 11:14:36.24524912 +0000 UTC m=+0.339450771,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-153.ec2.internal,}"
Sep 10 11:14:36.265419 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.265402    2580 manager.go:354] Recovery completed
Sep 10 11:14:36.269881 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.269869    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.271919 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.271895    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.271979 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.271931    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.271979 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.271940    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.272421 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.272408    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 11:14:36.272421 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.272420    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 11:14:36.272551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.272437    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 11:14:36.272551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.272476    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.273017 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.273000    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zpzv9"
Sep 10 11:14:36.273218 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.273203    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.273277 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.273235    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.273277 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.273249    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.273849 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.273775    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-153.ec2.internal.18d3f161158d3d9a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-153.ec2.internal,UID:ip-10-0-128-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-153.ec2.internal,},FirstTimestamp:2026-09-10 11:14:36.27191849 +0000 UTC m=+0.366120141,LastTimestamp:2026-09-10 11:14:36.27191849 +0000 UTC m=+0.366120141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-153.ec2.internal,}"
Sep 10 11:14:36.274648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.274636    2580 policy_none.go:49] "None policy: Start"
Sep 10 11:14:36.274701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.274653    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 11:14:36.274701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.274674    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 11:14:36.276591 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.276580    2580 policy_none.go:47] "Start"
Sep 10 11:14:36.283947 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.283889    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-153.ec2.internal.18d3f161158d7f2d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-153.ec2.internal,UID:ip-10-0-128-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-153.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-153.ec2.internal,},FirstTimestamp:2026-09-10 11:14:36.271935277 +0000 UTC m=+0.366136927,LastTimestamp:2026-09-10 11:14:36.271935277 +0000 UTC m=+0.366136927,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-153.ec2.internal,}"
Sep 10 11:14:36.286065 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.286051    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zpzv9"
Sep 10 11:14:36.286780 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.286720    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-153.ec2.internal.18d3f161158da2b1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-153.ec2.internal,UID:ip-10-0-128-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-153.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-153.ec2.internal,},FirstTimestamp:2026-09-10 11:14:36.271944369 +0000 UTC m=+0.366146020,LastTimestamp:2026-09-10 11:14:36.271944369 +0000 UTC m=+0.366146020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-153.ec2.internal,}"
Sep 10 11:14:36.318071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318053    2580 manager.go:337] "Starting Device Plugin manager"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.318094    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318108    2580 server.go:87] "Starting device plugin registration server"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318355    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318365    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318458    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318572    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.318584    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.318989    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 11:14:36.335637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.319031    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.410899 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.410871    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 11:14:36.412177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.412164    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 11:14:36.412257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.412203    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 11:14:36.412257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.412221    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 11:14:36.412257 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.412253    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 11:14:36.416637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.416617    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 11:14:36.418634 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.418621    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.419304 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.419289    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.419375 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.419315    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.419375 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.419328    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.419375 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.419347    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.430039 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.429981    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.430039 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.430003    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-153.ec2.internal\": node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.480776 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.480755    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.512650 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.512620    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"]
Sep 10 11:14:36.512721 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.512688    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.513422 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.513407    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.513500 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.513438    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.513500 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.513452    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.515506 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.515492    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.515623 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.515611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.515667 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.515640    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.516203 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.516176    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.516279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.516208    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.516279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.516221    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.516279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.516186    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.516367 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.516285    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.516367 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.516296    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.518185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.518170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.518255 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.518195    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:36.518870 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.518857    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:36.518937 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.518881    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:36.518937 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.518890    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:36.543082 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.543058    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-153.ec2.internal\" not found" node="ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.547411 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.547394    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-153.ec2.internal\" not found" node="ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.553618 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.553602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d139856900857b7f5ede0c0ce669dfe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal\" (UID: \"3d139856900857b7f5ede0c0ce669dfe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.553692 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.553624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d139856900857b7f5ede0c0ce669dfe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal\" (UID: \"3d139856900857b7f5ede0c0ce669dfe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.553692 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.553642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3788e9231500bda50f3f039c32df10fd-config\") pod \"kube-apiserver-proxy-ip-10-0-128-153.ec2.internal\" (UID: \"3788e9231500bda50f3f039c32df10fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.581326 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.581308    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.654182 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.654159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d139856900857b7f5ede0c0ce669dfe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal\" (UID: \"3d139856900857b7f5ede0c0ce669dfe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.654274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.654184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d139856900857b7f5ede0c0ce669dfe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal\" (UID: \"3d139856900857b7f5ede0c0ce669dfe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.654274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.654200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3788e9231500bda50f3f039c32df10fd-config\") pod \"kube-apiserver-proxy-ip-10-0-128-153.ec2.internal\" (UID: \"3788e9231500bda50f3f039c32df10fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.654274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.654222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3788e9231500bda50f3f039c32df10fd-config\") pod \"kube-apiserver-proxy-ip-10-0-128-153.ec2.internal\" (UID: \"3788e9231500bda50f3f039c32df10fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.654274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.654256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d139856900857b7f5ede0c0ce669dfe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal\" (UID: \"3d139856900857b7f5ede0c0ce669dfe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.654274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.654267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d139856900857b7f5ede0c0ce669dfe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal\" (UID: \"3d139856900857b7f5ede0c0ce669dfe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.682095 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.682057    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.782982 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.782953    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.845146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.845125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.849992 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:36.849741    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:36.883241 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.883219    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:36.983792 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:36.983717    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.084267 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.084237    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.184821 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.184792    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.196961 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.196941    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 11:14:37.197086 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.197070    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 11:14:37.285244 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.285187    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.289339 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.289315    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 11:09:36 +0000 UTC" deadline="2028-06-20 17:36:50.238308374 +0000 UTC"
Sep 10 11:14:37.289388 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.289339    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15582h22m12.948972073s"
Sep 10 11:14:37.386037 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.386013    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.421043 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.421015    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 11:14:37.421875 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.421855    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 11:14:37.421958 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.421885    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 11:14:37.421958 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.421896    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeHasSufficientPID"
Sep 10 11:14:37.451933 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.451912    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 11:14:37.487132 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.487106    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.587582 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.587522    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.607364 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:37.607341    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3788e9231500bda50f3f039c32df10fd.slice/crio-a6f99a144bf2a5ec0e89b5ebe9802237fa6ae185f6a0a2d92b74003bb7b16afc WatchSource:0}: Error finding container a6f99a144bf2a5ec0e89b5ebe9802237fa6ae185f6a0a2d92b74003bb7b16afc: Status 404 returned error can't find the container with id a6f99a144bf2a5ec0e89b5ebe9802237fa6ae185f6a0a2d92b74003bb7b16afc
Sep 10 11:14:37.612740 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.612726    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:14:37.687654 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.687631    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.788419 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:37.788378    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-153.ec2.internal\" not found"
Sep 10 11:14:37.812155 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.812122    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 11:14:37.827413 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.827390    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 11:14:37.852213 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.852157    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:37.869477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.869449    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 11:14:37.870523 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.870508    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal"
Sep 10 11:14:37.882968 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:37.882947    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 11:14:38.052923 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:38.052896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d139856900857b7f5ede0c0ce669dfe.slice/crio-66268409684cb9223105e7e0e58035929d46ccfa7f47539a8139bd177ed538c7 WatchSource:0}: Error finding container 66268409684cb9223105e7e0e58035929d46ccfa7f47539a8139bd177ed538c7: Status 404 returned error can't find the container with id 66268409684cb9223105e7e0e58035929d46ccfa7f47539a8139bd177ed538c7
Sep 10 11:14:38.235897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.235807    2580 apiserver.go:52] "Watching apiserver"
Sep 10 11:14:38.248043 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.248017    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 11:14:38.248447 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.248425    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-w2fx8","openshift-multus/multus-additional-cni-plugins-nh82c","openshift-network-operator/iptables-alerter-6w8dw","openshift-ovn-kubernetes/ovnkube-node-gkm6h","kube-system/global-pull-secret-syncer-fr9t7","kube-system/konnectivity-agent-fsnfx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal","openshift-multus/multus-zghbp","openshift-multus/network-metrics-daemon-x2kg2","openshift-network-diagnostics/network-check-target-9x6rr","kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7","openshift-cluster-node-tuning-operator/tuned-hb7sb","openshift-dns/node-resolver-cfmkf"]
Sep 10 11:14:38.251219 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.251198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:38.251339 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.251281    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:38.252132 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.252111    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 11:14:38.253790 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.253766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.255940 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.255918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.257958 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.257934    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.258175 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.258155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.258405 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.258386    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dd46k\""
Sep 10 11:14:38.258739 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.258718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.261058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.261040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.261160 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.261114    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:38.262311 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:38.262433 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262312    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 11:14:38.262433 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-modprobe-d\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262433 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysctl-conf\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262433 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysconfig\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-run\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-host\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysctl-d\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-systemd\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-var-lib-kubelet\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-kubernetes\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-sys\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-lib-modules\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-tuned\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.262683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c75e091f-8126-4f6f-b0c4-83b3511929f4-tmp\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.263123 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.262717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nbx\" (UniqueName: \"kubernetes.io/projected/c75e091f-8126-4f6f-b0c4-83b3511929f4-kube-api-access-c7nbx\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.263365 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.263344    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vns8z\""
Sep 10 11:14:38.264080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.263710    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.264080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.263785    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.264231 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.264167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.266306 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.266289    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.266407 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.266351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:38.266732 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.266712    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.271713 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.271693    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.272689 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.272670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.273393 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.273374    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 11:14:38.274425 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.274211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4v54n\""
Sep 10 11:14:38.275478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.274771    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 11:14:38.275478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.274852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 11:14:38.275478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.274883    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 11:14:38.275478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.275135    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.275478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.275321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-47rvq\""
Sep 10 11:14:38.275478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.275410    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 11:14:38.276057 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.276035    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 11:14:38.277252 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.277235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.277545 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.277325    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7wt5d\""
Sep 10 11:14:38.277545 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.277520    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 11:14:38.277685 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.277421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.277685 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.277454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v28gg\""
Sep 10 11:14:38.278359 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.278333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.279519 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.279495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.282065 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.282044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.283956 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.283932    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.285194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.285179    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.285292 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.285277    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 11:14:38.285592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.285568    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 11:14:38.285811 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.285788    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.285902 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.285891    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 11:14:38.285970 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.285949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 11:14:38.286080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.286066    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 11:14:38.286162 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.286145    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.286230 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.286206    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 11:14:38.286281 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.286259    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6lxq2\""
Sep 10 11:14:38.286528 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.286514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l7llh\""
Sep 10 11:14:38.286579 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.286536    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s2n6s\""
Sep 10 11:14:38.287529 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.287514    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 11:14:38.289626 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.289595    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 11:14:38.350319 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.350296    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmvq7"
Sep 10 11:14:38.353287 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.353266    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 11:14:38.362590 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.362537    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmvq7"
Sep 10 11:14:38.363637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06e98cfd-1f49-4a66-b727-8d91d2c64913-hosts-file\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.363717 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.363717 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-lib-modules\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.363826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nbx\" (UniqueName: \"kubernetes.io/projected/c75e091f-8126-4f6f-b0c4-83b3511929f4-kube-api-access-c7nbx\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.363826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f91d522e-b66a-4cbc-9bf1-d54ef38af245-konnectivity-ca\") pod \"konnectivity-agent-fsnfx\" (UID: \"f91d522e-b66a-4cbc-9bf1-d54ef38af245\") " pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.363826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-cnibin\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.363826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysconfig\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.363826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-host\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-cni-netd\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-lib-modules\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f91d522e-b66a-4cbc-9bf1-d54ef38af245-agent-certs\") pod \"konnectivity-agent-fsnfx\" (UID: \"f91d522e-b66a-4cbc-9bf1-d54ef38af245\") " pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysconfig\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-host\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.363984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06e98cfd-1f49-4a66-b727-8d91d2c64913-tmp-dir\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-registration-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.364062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9gsh\" (UniqueName: \"kubernetes.io/projected/b4ad6fac-23df-40cd-bafd-358e9d3f4400-kube-api-access-t9gsh\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54710b21-c748-4242-b8fc-384aae38a017-dbus\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-kubernetes\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6w8n\" (UniqueName: \"kubernetes.io/projected/87c06974-cfdb-477b-8b92-6572b5945a2d-kube-api-access-t6w8n\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-device-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-kubernetes\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-modprobe-d\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98340d79-4d50-406c-afe4-d1f371d44f1e-host-slash\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-slash\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-var-lib-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-log-socket\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.364455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-k8s-cni-cncf-io\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovnkube-config\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-modprobe-d\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84d28\" (UniqueName: \"kubernetes.io/projected/39c5cd93-7314-4cc8-a29d-5fc3203988ee-kube-api-access-84d28\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9606b213-0b2a-436d-be69-c0666cc75f1f-serviceca\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-cni-bin\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-cni-multus\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-hostroot\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-multus-certs\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc2tw\" (UniqueName: \"kubernetes.io/projected/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-kube-api-access-hc2tw\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-socket-dir-parent\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9l6k\" (UniqueName: \"kubernetes.io/projected/3247bcd5-fbfe-4596-8000-44f17413e29b-kube-api-access-x9l6k\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-sys\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c75e091f-8126-4f6f-b0c4-83b3511929f4-tmp\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.365000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.364934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-sys\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-cni-bin\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-socket-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysctl-conf\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98340d79-4d50-406c-afe4-d1f371d44f1e-iptables-alerter-script\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dzbs\" (UniqueName: \"kubernetes.io/projected/98340d79-4d50-406c-afe4-d1f371d44f1e-kube-api-access-4dzbs\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-systemd\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-system-cni-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysctl-conf\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87c06974-cfdb-477b-8b92-6572b5945a2d-cni-binary-copy\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-env-overrides\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9606b213-0b2a-436d-be69-c0666cc75f1f-host\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.365767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-etc-kubernetes\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysctl-d\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-var-lib-kubelet\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovnkube-script-lib\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-cni-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-sysctl-d\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-var-lib-kubelet\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-kubelet\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-conf-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-run-netns\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-tuned\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-kubelet\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-system-cni-dir\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovn-node-metrics-cert\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrz2c\" (UniqueName: \"kubernetes.io/projected/06e98cfd-1f49-4a66-b727-8d91d2c64913-kube-api-access-xrz2c\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.366442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-run\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.365969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-systemd-units\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-etc-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-netns\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-daemon-config\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54710b21-c748-4242-b8fc-384aae38a017-kubelet-config\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-cnibin\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-sys-fs\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-systemd\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-run\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-ovn\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-node-log\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-systemd\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkm2h\" (UniqueName: \"kubernetes.io/projected/9606b213-0b2a-436d-be69-c0666cc75f1f-kube-api-access-zkm2h\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.367176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.366477    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 11:14:38.370803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.370641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c75e091f-8126-4f6f-b0c4-83b3511929f4-etc-tuned\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.370906 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.370683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c75e091f-8126-4f6f-b0c4-83b3511929f4-tmp\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.379516 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.379494    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:14:38.379637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.379525    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:14:38.379637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.379556    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:38.379637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.379627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:38.879606914 +0000 UTC m=+2.973808570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:38.382387 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.382350    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nbx\" (UniqueName: \"kubernetes.io/projected/c75e091f-8126-4f6f-b0c4-83b3511929f4-kube-api-access-c7nbx\") pod \"tuned-hb7sb\" (UID: \"c75e091f-8126-4f6f-b0c4-83b3511929f4\") " pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.384627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.384605    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 11:14:38.418062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.418005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal" event={"ID":"3d139856900857b7f5ede0c0ce669dfe","Type":"ContainerStarted","Data":"66268409684cb9223105e7e0e58035929d46ccfa7f47539a8139bd177ed538c7"}
Sep 10 11:14:38.419353 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.419325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal" event={"ID":"3788e9231500bda50f3f039c32df10fd","Type":"ContainerStarted","Data":"a6f99a144bf2a5ec0e89b5ebe9802237fa6ae185f6a0a2d92b74003bb7b16afc"}
Sep 10 11:14:38.467294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98340d79-4d50-406c-afe4-d1f371d44f1e-iptables-alerter-script\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.467294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dzbs\" (UniqueName: \"kubernetes.io/projected/98340d79-4d50-406c-afe4-d1f371d44f1e-kube-api-access-4dzbs\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.467294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-systemd\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-system-cni-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87c06974-cfdb-477b-8b92-6572b5945a2d-cni-binary-copy\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-systemd\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-env-overrides\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9606b213-0b2a-436d-be69-c0666cc75f1f-host\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-etc-kubernetes\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-system-cni-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovnkube-script-lib\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.467627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-cni-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-kubelet\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-conf-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-run-netns\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-kubelet\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-system-cni-dir\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovn-node-metrics-cert\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrz2c\" (UniqueName: \"kubernetes.io/projected/06e98cfd-1f49-4a66-b727-8d91d2c64913-kube-api-access-xrz2c\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98340d79-4d50-406c-afe4-d1f371d44f1e-iptables-alerter-script\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-systemd-units\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-etc-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-netns\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.467943    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.467990    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:38.967976638 +0000 UTC m=+3.062178277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-env-overrides\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87c06974-cfdb-477b-8b92-6572b5945a2d-cni-binary-copy\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.468321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-etc-kubernetes\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-kubelet\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-daemon-config\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54710b21-c748-4242-b8fc-384aae38a017-kubelet-config\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-conf-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-cnibin\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-sys-fs\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-ovn\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-node-log\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-cni-dir\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkm2h\" (UniqueName: \"kubernetes.io/projected/9606b213-0b2a-436d-be69-c0666cc75f1f-kube-api-access-zkm2h\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-kubelet\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06e98cfd-1f49-4a66-b727-8d91d2c64913-hosts-file\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.469408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f91d522e-b66a-4cbc-9bf1-d54ef38af245-konnectivity-ca\") pod \"konnectivity-agent-fsnfx\" (UID: \"f91d522e-b66a-4cbc-9bf1-d54ef38af245\") " pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-cnibin\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54710b21-c748-4242-b8fc-384aae38a017-kubelet-config\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-cni-netd\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-cnibin\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f91d522e-b66a-4cbc-9bf1-d54ef38af245-agent-certs\") pod \"konnectivity-agent-fsnfx\" (UID: \"f91d522e-b66a-4cbc-9bf1-d54ef38af245\") " pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06e98cfd-1f49-4a66-b727-8d91d2c64913-tmp-dir\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-sys-fs\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-registration-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9gsh\" (UniqueName: \"kubernetes.io/projected/b4ad6fac-23df-40cd-bafd-358e9d3f4400-kube-api-access-t9gsh\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54710b21-c748-4242-b8fc-384aae38a017-dbus\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovnkube-script-lib\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-daemon-config\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6w8n\" (UniqueName: \"kubernetes.io/projected/87c06974-cfdb-477b-8b92-6572b5945a2d-kube-api-access-t6w8n\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54710b21-c748-4242-b8fc-384aae38a017-dbus\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.470279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.467658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9606b213-0b2a-436d-be69-c0666cc75f1f-host\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-device-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-run-ovn\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-node-log\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-netns\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98340d79-4d50-406c-afe4-d1f371d44f1e-host-slash\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-systemd-units\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06e98cfd-1f49-4a66-b727-8d91d2c64913-hosts-file\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-slash\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-var-lib-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-log-socket\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-k8s-cni-cncf-io\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovnkube-config\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.471394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84d28\" (UniqueName: \"kubernetes.io/projected/39c5cd93-7314-4cc8-a29d-5fc3203988ee-kube-api-access-84d28\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9606b213-0b2a-436d-be69-c0666cc75f1f-serviceca\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-cni-bin\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-cni-multus\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-hostroot\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-multus-certs\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc2tw\" (UniqueName: \"kubernetes.io/projected/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-kube-api-access-hc2tw\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-socket-dir-parent\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.468972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9l6k\" (UniqueName: \"kubernetes.io/projected/3247bcd5-fbfe-4596-8000-44f17413e29b-kube-api-access-x9l6k\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-cni-bin\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-run-netns\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-etc-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f91d522e-b66a-4cbc-9bf1-d54ef38af245-konnectivity-ca\") pod \"konnectivity-agent-fsnfx\" (UID: \"f91d522e-b66a-4cbc-9bf1-d54ef38af245\") " pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-socket-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.472354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9606b213-0b2a-436d-be69-c0666cc75f1f-serviceca\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06e98cfd-1f49-4a66-b727-8d91d2c64913-tmp-dir\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-var-lib-openvswitch\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-slash\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-k8s-cni-cncf-io\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98340d79-4d50-406c-afe4-d1f371d44f1e-host-slash\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-cnibin\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.469737    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-device-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.469803    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:14:38.96978556 +0000 UTC m=+3.063987214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-cni-multus\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-cni-netd\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-registration-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-log-socket\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-var-lib-cni-bin\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.474609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-host-run-multus-certs\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-host-cni-bin\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.469905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3247bcd5-fbfe-4596-8000-44f17413e29b-system-cni-dir\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.470016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4ad6fac-23df-40cd-bafd-358e9d3f4400-socket-dir\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.470054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-hostroot\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.470103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87c06974-cfdb-477b-8b92-6572b5945a2d-multus-socket-dir-parent\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.470105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.470311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovnkube-config\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.470623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3247bcd5-fbfe-4596-8000-44f17413e29b-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.473053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-ovn-node-metrics-cert\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.475498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.473261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f91d522e-b66a-4cbc-9bf1-d54ef38af245-agent-certs\") pod \"konnectivity-agent-fsnfx\" (UID: \"f91d522e-b66a-4cbc-9bf1-d54ef38af245\") " pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.481201 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.481153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dzbs\" (UniqueName: \"kubernetes.io/projected/98340d79-4d50-406c-afe4-d1f371d44f1e-kube-api-access-4dzbs\") pod \"iptables-alerter-6w8dw\" (UID: \"98340d79-4d50-406c-afe4-d1f371d44f1e\") " pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.481484 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.481464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkm2h\" (UniqueName: \"kubernetes.io/projected/9606b213-0b2a-436d-be69-c0666cc75f1f-kube-api-access-zkm2h\") pod \"node-ca-w2fx8\" (UID: \"9606b213-0b2a-436d-be69-c0666cc75f1f\") " pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.482060 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.482037    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6w8n\" (UniqueName: \"kubernetes.io/projected/87c06974-cfdb-477b-8b92-6572b5945a2d-kube-api-access-t6w8n\") pod \"multus-zghbp\" (UID: \"87c06974-cfdb-477b-8b92-6572b5945a2d\") " pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.483330 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.483304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9l6k\" (UniqueName: \"kubernetes.io/projected/3247bcd5-fbfe-4596-8000-44f17413e29b-kube-api-access-x9l6k\") pod \"multus-additional-cni-plugins-nh82c\" (UID: \"3247bcd5-fbfe-4596-8000-44f17413e29b\") " pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.485559 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.485516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc2tw\" (UniqueName: \"kubernetes.io/projected/6ec98ba0-1dd6-46c5-970d-d6477c8c7eca-kube-api-access-hc2tw\") pod \"ovnkube-node-gkm6h\" (UID: \"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.486222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.486146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9gsh\" (UniqueName: \"kubernetes.io/projected/b4ad6fac-23df-40cd-bafd-358e9d3f4400-kube-api-access-t9gsh\") pod \"aws-ebs-csi-driver-node-lmch7\" (UID: \"b4ad6fac-23df-40cd-bafd-358e9d3f4400\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.486464 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.486442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84d28\" (UniqueName: \"kubernetes.io/projected/39c5cd93-7314-4cc8-a29d-5fc3203988ee-kube-api-access-84d28\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.487669 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.487580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrz2c\" (UniqueName: \"kubernetes.io/projected/06e98cfd-1f49-4a66-b727-8d91d2c64913-kube-api-access-xrz2c\") pod \"node-resolver-cfmkf\" (UID: \"06e98cfd-1f49-4a66-b727-8d91d2c64913\") " pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.567868 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.567843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hb7sb"
Sep 10 11:14:38.578396 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.578366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6w8dw"
Sep 10 11:14:38.586879 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.586860    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:14:38.591705 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.591687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:14:38.597549 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.597530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cfmkf"
Sep 10 11:14:38.603135 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.603115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nh82c"
Sep 10 11:14:38.607679 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.607660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w2fx8"
Sep 10 11:14:38.614291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.614271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zghbp"
Sep 10 11:14:38.621189 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.621171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7"
Sep 10 11:14:38.974722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.974648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:38.974722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.974695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:38.974933 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.974817    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:38.974933 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.974819    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:38.974933 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.974880    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:39.974861607 +0000 UTC m=+4.069063253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:38.974933 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:38.974909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:38.975145 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.974993    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:14:39.974976268 +0000 UTC m=+4.069177921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:38.975145 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.975018    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:14:38.975145 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.975035    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:14:38.975145 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.975045    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:38.975145 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:38.975076    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:39.975067293 +0000 UTC m=+4.069268932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:39.366146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.366054    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 11:09:38 +0000 UTC" deadline="2028-06-05 16:28:07.2853184 +0000 UTC"
Sep 10 11:14:39.366146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.366103    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15221h13m27.919217684s"
Sep 10 11:14:39.413545 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.413516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:39.413688 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.413515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:39.413688 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.413669    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:39.413852 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.413747    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:39.713722 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:39.713678    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75e091f_8126_4f6f_b0c4_83b3511929f4.slice/crio-f1a3a03555d621d31337b0840a9a75ae46414cbdcab33dd4fa904b2c8bc2a38d WatchSource:0}: Error finding container f1a3a03555d621d31337b0840a9a75ae46414cbdcab33dd4fa904b2c8bc2a38d: Status 404 returned error can't find the container with id f1a3a03555d621d31337b0840a9a75ae46414cbdcab33dd4fa904b2c8bc2a38d
Sep 10 11:14:39.724354 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:39.724324    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e98cfd_1f49_4a66_b727_8d91d2c64913.slice/crio-ae61d37161cdf1aefd2f6537623f88f0765190a3263797f7f8977a961749cd93 WatchSource:0}: Error finding container ae61d37161cdf1aefd2f6537623f88f0765190a3263797f7f8977a961749cd93: Status 404 returned error can't find the container with id ae61d37161cdf1aefd2f6537623f88f0765190a3263797f7f8977a961749cd93
Sep 10 11:14:39.736508 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:39.736479    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c06974_cfdb_477b_8b92_6572b5945a2d.slice/crio-e64963673b2756d5d34f2b6514fa5150e867d7ccbdfdda78500100e93ee200e5 WatchSource:0}: Error finding container e64963673b2756d5d34f2b6514fa5150e867d7ccbdfdda78500100e93ee200e5: Status 404 returned error can't find the container with id e64963673b2756d5d34f2b6514fa5150e867d7ccbdfdda78500100e93ee200e5
Sep 10 11:14:39.737307 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:14:39.737126    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98340d79_4d50_406c_afe4_d1f371d44f1e.slice/crio-e9fd84a1492069352f579dd19cf66511405eeaced29e29632d144137a72a5bde WatchSource:0}: Error finding container e9fd84a1492069352f579dd19cf66511405eeaced29e29632d144137a72a5bde: Status 404 returned error can't find the container with id e9fd84a1492069352f579dd19cf66511405eeaced29e29632d144137a72a5bde
Sep 10 11:14:39.983387 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.983349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:39.983387 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.983386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:39.983418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983481    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983535    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983549    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983568    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983579    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983557    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:14:41.983536421 +0000 UTC m=+6.077738063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983618    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:41.983605222 +0000 UTC m=+6.077806862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:39.983648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:39.983632    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:41.983622907 +0000 UTC m=+6.077824546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:40.366725 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.366682    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 11:09:38 +0000 UTC" deadline="2028-03-12 05:48:14.001789635 +0000 UTC"
Sep 10 11:14:40.366725 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.366723    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13170h33m33.635071265s"
Sep 10 11:14:40.414755 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.414720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:40.414932 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:40.414851    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:40.428181 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.428084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hb7sb" event={"ID":"c75e091f-8126-4f6f-b0c4-83b3511929f4","Type":"ContainerStarted","Data":"f1a3a03555d621d31337b0840a9a75ae46414cbdcab33dd4fa904b2c8bc2a38d"}
Sep 10 11:14:40.441678 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.441540    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d139856900857b7f5ede0c0ce669dfe" containerID="efb9015c48a03af6190ac33824d96c82a0d84640ff08c768ef3734dd73c9faf6" exitCode=0
Sep 10 11:14:40.441897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.441641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal" event={"ID":"3d139856900857b7f5ede0c0ce669dfe","Type":"ContainerDied","Data":"efb9015c48a03af6190ac33824d96c82a0d84640ff08c768ef3734dd73c9faf6"}
Sep 10 11:14:40.461252 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.461226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal" event={"ID":"3788e9231500bda50f3f039c32df10fd","Type":"ContainerStarted","Data":"15e6eed619ea6c5219034340a341c86b1ac16f2be430697cad8b93f25aa373c4"}
Sep 10 11:14:40.479146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.479115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6w8dw" event={"ID":"98340d79-4d50-406c-afe4-d1f371d44f1e","Type":"ContainerStarted","Data":"e9fd84a1492069352f579dd19cf66511405eeaced29e29632d144137a72a5bde"}
Sep 10 11:14:40.497128 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.497100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zghbp" event={"ID":"87c06974-cfdb-477b-8b92-6572b5945a2d","Type":"ContainerStarted","Data":"e64963673b2756d5d34f2b6514fa5150e867d7ccbdfdda78500100e93ee200e5"}
Sep 10 11:14:40.501181 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.501070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"297a0230c4c8b9b3a051301d9e3ca67c58fa1a7839c6044e9d6e270c5a482733"}
Sep 10 11:14:40.522049 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.521978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7" event={"ID":"b4ad6fac-23df-40cd-bafd-358e9d3f4400","Type":"ContainerStarted","Data":"8d4a6b10dbfa8608fcacfeccedc95545b79dcdb60a52217b6d5df99e0dc9a757"}
Sep 10 11:14:40.546299 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.546265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerStarted","Data":"aa79ec9ed33cf0660bb4daba84003df813e4181577a64b84b9d7d7a3954a1dad"}
Sep 10 11:14:40.548164 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.548138    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cfmkf" event={"ID":"06e98cfd-1f49-4a66-b727-8d91d2c64913","Type":"ContainerStarted","Data":"ae61d37161cdf1aefd2f6537623f88f0765190a3263797f7f8977a961749cd93"}
Sep 10 11:14:40.563409 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.563374    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fsnfx" event={"ID":"f91d522e-b66a-4cbc-9bf1-d54ef38af245","Type":"ContainerStarted","Data":"378589cedf5e79350bd0665783ff9a837477102b1cd1ad26b69339b00d2c3112"}
Sep 10 11:14:40.571023 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:40.570949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w2fx8" event={"ID":"9606b213-0b2a-436d-be69-c0666cc75f1f","Type":"ContainerStarted","Data":"e0ec16d1e78baa21514b2b3bd97dffb0acb4df3e3a951c080467b650c2c915fd"}
Sep 10 11:14:41.412825 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:41.412791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:41.413380 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:41.412929    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:41.413380 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:41.412803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:41.413380 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:41.413147    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:41.594931 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:41.594897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal" event={"ID":"3d139856900857b7f5ede0c0ce669dfe","Type":"ContainerStarted","Data":"29ce935dcc3740b7d3daf641c4d0cc160cb973cb8f72faed59ccf68039119231"}
Sep 10 11:14:41.615268 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:41.615211    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-153.ec2.internal" podStartSLOduration=3.615193387 podStartE2EDuration="3.615193387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:40.508080402 +0000 UTC m=+4.602282066" watchObservedRunningTime="2026-09-10 11:14:41.615193387 +0000 UTC m=+5.709395050"
Sep 10 11:14:42.005407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:42.005371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:42.005613 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:42.005426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:42.005613 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:42.005462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:42.005746 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005627    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:14:42.005746 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005647    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:14:42.005746 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005659    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:42.005746 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005711    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:46.005694015 +0000 UTC m=+10.099895670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:42.005941 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005784    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:42.005941 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005816    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:14:46.005805806 +0000 UTC m=+10.100007447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:42.005941 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005867    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:42.005941 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.005894    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:46.005885097 +0000 UTC m=+10.100086740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:42.418845 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:42.418770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:42.419270 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:42.418887    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:43.413219 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:43.413186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:43.413420 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:43.413324    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:43.413872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:43.413717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:43.413872 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:43.413836    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:44.414948 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:44.413311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:44.414948 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:44.413440    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:45.412814 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:45.412473    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:45.412814 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:45.412520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:45.413030 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:45.412863    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:45.413273 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:45.413237    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:46.041192 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:46.041158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:46.041208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:46.041235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041340    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041352    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041360    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041401    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:54.041389998 +0000 UTC m=+18.135591636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041448    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041485    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:14:54.041462333 +0000 UTC m=+18.135663970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041517    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:46.041616 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.041551    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:14:54.041544693 +0000 UTC m=+18.135746330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:46.414304 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:46.414231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:46.414446 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:46.414346    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:47.413964 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:47.412938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:47.413964 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:47.412937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:47.413964 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:47.413043    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:47.413964 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:47.413137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:48.413007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:48.412974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:48.413220 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:48.413096    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:49.413655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:49.412997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:49.413655 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:49.413101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:49.413655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:49.413516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:49.413655 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:49.413618    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:50.413303 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:50.413283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:50.413401 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:50.413384    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:51.412754 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:51.412719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:51.413153 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:51.412725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:51.413153 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:51.412849    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:51.413153 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:51.412932    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:52.416567 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:52.416543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:52.417018 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:52.416636    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:53.413238 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:53.413201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:53.413457 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:53.413331    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:53.413457 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:53.413383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:53.413545 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:53.413479    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:54.102212 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:54.102190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:54.102225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:54.102247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102336    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102358    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102374    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102382    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102389    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:15:10.102374659 +0000 UTC m=+34.196576301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102336    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102416    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:10.102405993 +0000 UTC m=+34.196607634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:14:54.102444 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.102433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:10.102423241 +0000 UTC m=+34.196624903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:14:54.412959 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:54.412865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:54.413113 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:54.413001    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:55.412829 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:55.412793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:55.413253 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:55.412839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:55.413253 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:55.412931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:55.413253 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:55.413061    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:56.413676 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:56.413642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:56.414102 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:56.413758    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:57.412779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:57.412751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:57.412924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:57.412757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:57.412924 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:57.412845    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:57.413019 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:57.412926    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:58.413260 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.413029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:14:58.413914 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:58.413368    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:14:58.635185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.635152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zghbp" event={"ID":"87c06974-cfdb-477b-8b92-6572b5945a2d","Type":"ContainerStarted","Data":"30c6deb6248f73215f087b981ddc77252dd1cc16cbe0b544aa1fee896acd8304"}
Sep 10 11:14:58.637957 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.637935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"b444582913720785cef0fa70b0b63301ec713a5c60e64f2e393458f00c2cc5c9"}
Sep 10 11:14:58.638058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.637992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"0317ecf8f97a6270c5a67eb8f99f2730af6db29e6304dc3b4dabd8083476c9f1"}
Sep 10 11:14:58.638058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.638051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"117e2dfd167ccb98da8737e5ba8e93269943f7f5a2543638cab1227bfe12a581"}
Sep 10 11:14:58.638160 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.638087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"83e298099bf4c68bd7c1ffe0eb3dc110e95015d0b04ef5012d5af34157cff033"}
Sep 10 11:14:58.638160 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.638123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"ce601ffe7c4c9d79cc0d11655f32bab0238999a47049113a61ef05af9e3a3c21"}
Sep 10 11:14:58.638217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.638167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"88ba7c469800ca894012432190bc135b26f47c2ae19952f4a53e86df1f171018"}
Sep 10 11:14:58.639317 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.639295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7" event={"ID":"b4ad6fac-23df-40cd-bafd-358e9d3f4400","Type":"ContainerStarted","Data":"43c9714ef50095a59e3128adce4ac4b9b154dbc97a35fac1f123d0290cd6316f"}
Sep 10 11:14:58.640722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.640701    2580 generic.go:356] "Generic (PLEG): container finished" podID="3247bcd5-fbfe-4596-8000-44f17413e29b" containerID="397e57f369c21dd351b4ac2ea754de7e36328ead131eff0015c6f305f33c196f" exitCode=0
Sep 10 11:14:58.640802 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.640761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerDied","Data":"397e57f369c21dd351b4ac2ea754de7e36328ead131eff0015c6f305f33c196f"}
Sep 10 11:14:58.642274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.642181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cfmkf" event={"ID":"06e98cfd-1f49-4a66-b727-8d91d2c64913","Type":"ContainerStarted","Data":"f07dc24a7c92fe42872007af7ebd6b2bf26227c2333788e08baf61686778c61d"}
Sep 10 11:14:58.643660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.643631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fsnfx" event={"ID":"f91d522e-b66a-4cbc-9bf1-d54ef38af245","Type":"ContainerStarted","Data":"8c6aaa0d12ab125cd034521b4a20ed763f77aeca532cf852386d92f38fcf6032"}
Sep 10 11:14:58.645026 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.644998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w2fx8" event={"ID":"9606b213-0b2a-436d-be69-c0666cc75f1f","Type":"ContainerStarted","Data":"f20f546f998ff8458bbeef38720f29bfba12c3dc88f332a276dbfafbec19db4b"}
Sep 10 11:14:58.646327 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.646305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hb7sb" event={"ID":"c75e091f-8126-4f6f-b0c4-83b3511929f4","Type":"ContainerStarted","Data":"a8397090c79fa0388b8f34af88f4414d5b5324f414d76d08474a1efd831496cb"}
Sep 10 11:14:58.667402 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.667357    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-153.ec2.internal" podStartSLOduration=20.66734595 podStartE2EDuration="20.66734595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:41.615345652 +0000 UTC m=+5.709547305" watchObservedRunningTime="2026-09-10 11:14:58.66734595 +0000 UTC m=+22.761547610"
Sep 10 11:14:58.667513 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.667441    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zghbp" podStartSLOduration=4.296867358 podStartE2EDuration="22.667433954s" totalImagesPullingTime="18.370566596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:58.667218411 +0000 UTC m=+22.761420081" watchObservedRunningTime="2026-09-10 11:14:58.667433954 +0000 UTC m=+22.761635632"
Sep 10 11:14:58.721500 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.721415    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fsnfx" podStartSLOduration=8.35899671 podStartE2EDuration="22.721403218s" totalImagesPullingTime="14.362406508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:58.721150815 +0000 UTC m=+22.815352474" watchObservedRunningTime="2026-09-10 11:14:58.721403218 +0000 UTC m=+22.815604878"
Sep 10 11:14:58.772707 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.772669    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cfmkf" podStartSLOduration=4.627910165 podStartE2EDuration="22.772657107s" totalImagesPullingTime="18.144746942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:58.755057741 +0000 UTC m=+22.849259400" watchObservedRunningTime="2026-09-10 11:14:58.772657107 +0000 UTC m=+22.866858767"
Sep 10 11:14:58.799668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.799634    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hb7sb" podStartSLOduration=4.609934664 podStartE2EDuration="22.799621833s" totalImagesPullingTime="18.189687169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:58.799035688 +0000 UTC m=+22.893237349" watchObservedRunningTime="2026-09-10 11:14:58.799621833 +0000 UTC m=+22.893823492"
Sep 10 11:14:58.799774 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:58.799743    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w2fx8" podStartSLOduration=4.659932142 podStartE2EDuration="22.799737967s" totalImagesPullingTime="18.139805825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:58.772881778 +0000 UTC m=+22.867083438" watchObservedRunningTime="2026-09-10 11:14:58.799737967 +0000 UTC m=+22.893939659"
Sep 10 11:14:59.412621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:59.412581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:14:59.412621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:59.412620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:14:59.412851 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:59.412733    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:14:59.412908 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:14:59.412856    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:14:59.650699 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:59.650618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6w8dw" event={"ID":"98340d79-4d50-406c-afe4-d1f371d44f1e","Type":"ContainerStarted","Data":"3c8fdf212dee825df63c16f4b850febc656b1afe4cede97eb521e143fc8f2575"}
Sep 10 11:14:59.682111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:59.682056    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6w8dw" podStartSLOduration=5.550112836 podStartE2EDuration="23.682037703s" totalImagesPullingTime="18.131924867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:14:59.681839242 +0000 UTC m=+23.776040903" watchObservedRunningTime="2026-09-10 11:14:59.682037703 +0000 UTC m=+23.776239363"
Sep 10 11:14:59.855444 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:59.855059    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 11:14:59.977254 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:14:59.977132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fsnfx_f91d522e-b66a-4cbc-9bf1-d54ef38af245/konnectivity-agent/0.log" limit=1024
Sep 10 11:15:00.111901 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:00.111844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fsnfx_f91d522e-b66a-4cbc-9bf1-d54ef38af245/konnectivity-agent/0.log" limit=1024
Sep 10 11:15:00.336267 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:00.336129    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T11:14:59.855224959Z","UUID":"9843172d-9b83-48b3-9b26-59a337b53ee6","Handler":null,"Name":"","Endpoint":""}
Sep 10 11:15:00.338150 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:00.338130    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 11:15:00.338279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:00.338166    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 11:15:00.413080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:00.413049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:00.413239 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:00.413160    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:15:00.654446 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:00.654366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7" event={"ID":"b4ad6fac-23df-40cd-bafd-358e9d3f4400","Type":"ContainerStarted","Data":"8fd8490e20335f9f45c027dbfca3fa3cdd51f1276640d6368587f951728c4f94"}
Sep 10 11:15:01.412598 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:01.412563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:01.412755 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:01.412691    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:15:01.412811 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:01.412756    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:01.412902 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:01.412879    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:15:01.660593 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:01.660484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"01f929c752b002c791cb9224e3c95fe47ac76806671b2b9bd1e25ad5077e5f26"}
Sep 10 11:15:01.663271 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:01.663209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7" event={"ID":"b4ad6fac-23df-40cd-bafd-358e9d3f4400","Type":"ContainerStarted","Data":"2ae62fc2851455a00bf6fe5a310eefd1a7fa4b555ddf8649dbcdd1f02a7a8bc7"}
Sep 10 11:15:02.413425 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:02.413392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:02.413619 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:02.413510    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:15:02.844667 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:02.844634    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:15:02.845277 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:02.845253    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:15:02.877416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:02.877368    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmch7" podStartSLOduration=5.5588783 podStartE2EDuration="26.877350948s" totalImagesPullingTime="21.318472648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:01.705621758 +0000 UTC m=+25.799823418" watchObservedRunningTime="2026-09-10 11:15:02.877350948 +0000 UTC m=+26.971552617"
Sep 10 11:15:03.413266 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.413237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:03.413415 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:03.413340    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:15:03.413415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.413399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:03.413585 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:03.413550    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:15:03.671905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.671704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" event={"ID":"6ec98ba0-1dd6-46c5-970d-d6477c8c7eca","Type":"ContainerStarted","Data":"9f125128b5bb145f45544713ebbf4dbaccf440d5e785fb6644d6984578c3fad5"}
Sep 10 11:15:03.672354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.672131    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:15:03.672354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.672182    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:15:03.672486 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.672473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fsnfx"
Sep 10 11:15:03.721235 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:03.721182    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h" podStartSLOduration=9.509374022 podStartE2EDuration="27.721165887s" totalImagesPullingTime="18.211791865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:03.720690355 +0000 UTC m=+27.814892018" watchObservedRunningTime="2026-09-10 11:15:03.721165887 +0000 UTC m=+27.815367917"
Sep 10 11:15:04.413105 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.413044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:04.413490 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:04.413141    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:15:04.676216 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.676142    2580 generic.go:356] "Generic (PLEG): container finished" podID="3247bcd5-fbfe-4596-8000-44f17413e29b" containerID="0da74c21ed21ada37d6abaa63841d934fb2134336a83113748ad41a580a0907e" exitCode=0
Sep 10 11:15:04.676359 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.676227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerDied","Data":"0da74c21ed21ada37d6abaa63841d934fb2134336a83113748ad41a580a0907e"}
Sep 10 11:15:04.676944 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.676912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:15:04.677007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.676985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:15:04.692257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.692234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:15:04.692360 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:04.692341    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:15:05.412930 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.412892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:05.413156 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.412892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:05.413156 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:05.413030    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:15:05.413156 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:05.413117    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:15:05.676341 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.676259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9x6rr"]
Sep 10 11:15:05.676484 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.676393    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:05.676571 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:05.676490    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:15:05.682831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.682783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fr9t7"]
Sep 10 11:15:05.682945 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.682898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:05.683009 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:05.682983    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:15:05.683477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.683458    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x2kg2"]
Sep 10 11:15:05.683568 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:05.683547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:05.683638 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:05.683622    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:15:07.413396 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:07.413226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:07.413969 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:07.413285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:07.413969 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:07.413467    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:15:07.413969 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:07.413285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:07.413969 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:07.413557    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:15:07.413969 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:07.413665    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:15:07.684770 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:07.684739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerStarted","Data":"21cc1c3c5acff4cdb51398b522b41448478d70b5e2faaa00bfa9fffc6138748f"}
Sep 10 11:15:08.688774 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:08.688738    2580 generic.go:356] "Generic (PLEG): container finished" podID="3247bcd5-fbfe-4596-8000-44f17413e29b" containerID="21cc1c3c5acff4cdb51398b522b41448478d70b5e2faaa00bfa9fffc6138748f" exitCode=0
Sep 10 11:15:08.689144 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:08.688784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerDied","Data":"21cc1c3c5acff4cdb51398b522b41448478d70b5e2faaa00bfa9fffc6138748f"}
Sep 10 11:15:09.413078 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:09.413026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:09.413162 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:09.413142    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fr9t7" podUID="54710b21-c748-4242-b8fc-384aae38a017"
Sep 10 11:15:09.413419 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:09.413405    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:09.413465 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:09.413430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:09.413504 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:09.413490    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x6rr" podUID="85b44cfe-cf83-4378-9eea-85e738d47d51"
Sep 10 11:15:09.413590 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:09.413575    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2kg2" podUID="39c5cd93-7314-4cc8-a29d-5fc3203988ee"
Sep 10 11:15:09.693000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:09.692934    2580 generic.go:356] "Generic (PLEG): container finished" podID="3247bcd5-fbfe-4596-8000-44f17413e29b" containerID="bf389e9cad50f8a488dc00c78a2e049da5acce0ab09b3037fccada22036eb58f" exitCode=0
Sep 10 11:15:09.693000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:09.692972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerDied","Data":"bf389e9cad50f8a488dc00c78a2e049da5acce0ab09b3037fccada22036eb58f"}
Sep 10 11:15:10.117445 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.117413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:10.117445 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.117449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.117469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117578    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117586    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117602    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117610    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhkqr for pod openshift-network-diagnostics/network-check-target-9x6rr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117628    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret podName:54710b21-c748-4242-b8fc-384aae38a017 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:42.117613973 +0000 UTC m=+66.211815611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret") pod "global-pull-secret-syncer-fr9t7" (UID: "54710b21-c748-4242-b8fc-384aae38a017") : object "kube-system"/"original-pull-secret" not registered
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117652    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr podName:85b44cfe-cf83-4378-9eea-85e738d47d51 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:42.117638931 +0000 UTC m=+66.211840582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhkqr" (UniqueName: "kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr") pod "network-check-target-9x6rr" (UID: "85b44cfe-cf83-4378-9eea-85e738d47d51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 11:15:10.117659 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117585    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:15:10.117914 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.117677    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:15:42.117671127 +0000 UTC m=+66.211872764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 11:15:10.663202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.663171    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-153.ec2.internal" event="NodeReady"
Sep 10 11:15:10.663402 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.663313    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 11:15:10.795033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.794959    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9p7nx"]
Sep 10 11:15:10.796765 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.796742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:10.800686 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.800661    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 11:15:10.802994 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.802970    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 11:15:10.803083 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.803003    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w7x6j\""
Sep 10 11:15:10.803176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.803162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 11:15:10.824954 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.824921    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9p7nx"]
Sep 10 11:15:10.840379 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.840350    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qgbm6"]
Sep 10 11:15:10.842286 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.842254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:10.845611 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.845583    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-default-metrics-tls\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret"
Sep 10 11:15:10.845795 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.845769    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-dockercfg-krm6r\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krm6r\"" type="*v1.Secret"
Sep 10 11:15:10.845859 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:10.845803    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-default\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap"
Sep 10 11:15:10.872270 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.872236    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgbm6"]
Sep 10 11:15:10.923905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.923874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbkl\" (UniqueName: \"kubernetes.io/projected/0e7eab7c-03a7-472d-93ba-083772a05e1a-kube-api-access-mjbkl\") pod \"ingress-canary-9p7nx\" (UID: \"0e7eab7c-03a7-472d-93ba-083772a05e1a\") " pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:10.924106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.923913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-config-volume\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:10.924106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.923942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:10.924106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.923961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mcds\" (UniqueName: \"kubernetes.io/projected/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-kube-api-access-8mcds\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:10.924106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.923984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-tmp-dir\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:10.924106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:10.924020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e7eab7c-03a7-472d-93ba-083772a05e1a-cert\") pod \"ingress-canary-9p7nx\" (UID: \"0e7eab7c-03a7-472d-93ba-083772a05e1a\") " pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:11.024799 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.024767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbkl\" (UniqueName: \"kubernetes.io/projected/0e7eab7c-03a7-472d-93ba-083772a05e1a-kube-api-access-mjbkl\") pod \"ingress-canary-9p7nx\" (UID: \"0e7eab7c-03a7-472d-93ba-083772a05e1a\") " pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:11.024799 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.024803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-config-volume\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:11.025024 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.024828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:11.025024 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.024851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mcds\" (UniqueName: \"kubernetes.io/projected/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-kube-api-access-8mcds\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:11.025024 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.024888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-tmp-dir\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:11.025024 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.024949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e7eab7c-03a7-472d-93ba-083772a05e1a-cert\") pod \"ingress-canary-9p7nx\" (UID: \"0e7eab7c-03a7-472d-93ba-083772a05e1a\") " pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:11.025237 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.025220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-tmp-dir\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:11.029155 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.029133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e7eab7c-03a7-472d-93ba-083772a05e1a-cert\") pod \"ingress-canary-9p7nx\" (UID: \"0e7eab7c-03a7-472d-93ba-083772a05e1a\") " pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:11.043836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.043806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbkl\" (UniqueName: \"kubernetes.io/projected/0e7eab7c-03a7-472d-93ba-083772a05e1a-kube-api-access-mjbkl\") pod \"ingress-canary-9p7nx\" (UID: \"0e7eab7c-03a7-472d-93ba-083772a05e1a\") " pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:11.045480 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.045441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mcds\" (UniqueName: \"kubernetes.io/projected/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-kube-api-access-8mcds\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:11.107544 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.107512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9p7nx"
Sep 10 11:15:11.403476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.403269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9p7nx"]
Sep 10 11:15:11.405255 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:15:11.405228    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7eab7c_03a7_472d_93ba_083772a05e1a.slice/crio-3535ce4d05bc517a8c489587e6f9cd67f0fc867fd0c08c0d3668b604e2564774 WatchSource:0}: Error finding container 3535ce4d05bc517a8c489587e6f9cd67f0fc867fd0c08c0d3668b604e2564774: Status 404 returned error can't find the container with id 3535ce4d05bc517a8c489587e6f9cd67f0fc867fd0c08c0d3668b604e2564774
Sep 10 11:15:11.413121 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.413099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:11.413222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.413127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:11.413222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.413102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:11.423891 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.423708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 11:15:11.423891 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.423734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 11:15:11.424977 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.424957    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 11:15:11.425125 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.425107    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7sc2\""
Sep 10 11:15:11.425215 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.425174    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kdff\""
Sep 10 11:15:11.425371 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.425358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 11:15:11.699858 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.699775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9p7nx" event={"ID":"0e7eab7c-03a7-472d-93ba-083772a05e1a","Type":"ContainerStarted","Data":"3535ce4d05bc517a8c489587e6f9cd67f0fc867fd0c08c0d3668b604e2564774"}
Sep 10 11:15:11.720034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.720007    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 11:15:11.725743 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:11.725717    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:11.725864 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:11.725793    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:15:12.225771201 +0000 UTC m=+36.319972841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:11.993655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.993630    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 11:15:11.996142 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:11.996120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-config-volume\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:12.150565 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:12.150523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krm6r\""
Sep 10 11:15:12.235282 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:12.235253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:12.235429 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:12.235360    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:12.235429 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:12.235417    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:15:13.235400081 +0000 UTC m=+37.329601721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:13.244465 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:13.244434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:13.244901 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:13.244614    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:13.244901 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:13.244687    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:15:15.244665668 +0000 UTC m=+39.338867309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:14.711034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:14.710994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerStarted","Data":"803e4b773ea22c0066fd2db0b063111f32087347683fe3128e895d41b6f93ca1"}
Sep 10 11:15:15.260505 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:15.260476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:15.260662 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:15.260611    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:15.260662 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:15.260661    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:15:19.260649398 +0000 UTC m=+43.354851049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:15.715741 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:15.715713    2580 generic.go:356] "Generic (PLEG): container finished" podID="3247bcd5-fbfe-4596-8000-44f17413e29b" containerID="803e4b773ea22c0066fd2db0b063111f32087347683fe3128e895d41b6f93ca1" exitCode=0
Sep 10 11:15:15.716014 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:15.715770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerDied","Data":"803e4b773ea22c0066fd2db0b063111f32087347683fe3128e895d41b6f93ca1"}
Sep 10 11:15:16.725042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:16.724780    2580 generic.go:356] "Generic (PLEG): container finished" podID="3247bcd5-fbfe-4596-8000-44f17413e29b" containerID="13f9653e707d4863df74c7b9c6e0969a61ae4ed07828706b2460bc922d12b82e" exitCode=0
Sep 10 11:15:16.725440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:16.724855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerDied","Data":"13f9653e707d4863df74c7b9c6e0969a61ae4ed07828706b2460bc922d12b82e"}
Sep 10 11:15:16.726703 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:16.726685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9p7nx" event={"ID":"0e7eab7c-03a7-472d-93ba-083772a05e1a","Type":"ContainerStarted","Data":"5c294479ae1b6e765df367c1d04c2c273cea7a4c676315648257bc84fa332c3b"}
Sep 10 11:15:16.838028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:16.837977    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9p7nx" podStartSLOduration=2.616868491 podStartE2EDuration="6.837957689s" totalImagesPullingTime="4.221089198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:16.836035266 +0000 UTC m=+40.930236925" watchObservedRunningTime="2026-09-10 11:15:16.837957689 +0000 UTC m=+40.932159366"
Sep 10 11:15:17.732691 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:17.732652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh82c" event={"ID":"3247bcd5-fbfe-4596-8000-44f17413e29b","Type":"ContainerStarted","Data":"bdd6acbd8dda77ea0661ebffe04a7a1867e722bde84b43a2cbcb5cab30013954"}
Sep 10 11:15:17.769646 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:17.769600    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nh82c" podStartSLOduration=10.24721892 podStartE2EDuration="41.769587129s" totalImagesPullingTime="31.522368209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:17.768874398 +0000 UTC m=+41.863076057" watchObservedRunningTime="2026-09-10 11:15:17.769587129 +0000 UTC m=+41.863788789"
Sep 10 11:15:19.287576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:19.287545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:19.287949 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:19.287665    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:19.287949 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:19.287722    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:15:27.287709549 +0000 UTC m=+51.381911201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:27.163024 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.162995    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"]
Sep 10 11:15:27.175983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.175965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"
Sep 10 11:15:27.178399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.178372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"]
Sep 10 11:15:27.181635 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.181613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2rzb4\""
Sep 10 11:15:27.182439 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.182414    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 11:15:27.184716 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.184699    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 11:15:27.333426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.333403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcx77\" (UniqueName: \"kubernetes.io/projected/55fc7c18-e7d6-45dd-a6db-a0d04f54cc97-kube-api-access-qcx77\") pod \"volume-data-source-validator-695c895bd6-cc5qc\" (UID: \"55fc7c18-e7d6-45dd-a6db-a0d04f54cc97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"
Sep 10 11:15:27.333578 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.333468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:27.333648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:27.333584    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:27.333648 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:27.333645    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:15:43.333626606 +0000 UTC m=+67.427828258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:27.433981 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.433925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcx77\" (UniqueName: \"kubernetes.io/projected/55fc7c18-e7d6-45dd-a6db-a0d04f54cc97-kube-api-access-qcx77\") pod \"volume-data-source-validator-695c895bd6-cc5qc\" (UID: \"55fc7c18-e7d6-45dd-a6db-a0d04f54cc97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"
Sep 10 11:15:27.446825 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.446806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcx77\" (UniqueName: \"kubernetes.io/projected/55fc7c18-e7d6-45dd-a6db-a0d04f54cc97-kube-api-access-qcx77\") pod \"volume-data-source-validator-695c895bd6-cc5qc\" (UID: \"55fc7c18-e7d6-45dd-a6db-a0d04f54cc97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"
Sep 10 11:15:27.486323 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.486299    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"
Sep 10 11:15:27.685339 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.685270    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-664cd9c55b-hvdjv"]
Sep 10 11:15:27.705924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.705899    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.709001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.708980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 11:15:27.709951 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.709932    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 11:15:27.710021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.709968    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 11:15:27.710183 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.710165    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 11:15:27.710267 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.710212    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 11:15:27.710726 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.710711    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 11:15:27.711158 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.711139    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bxzls\""
Sep 10 11:15:27.721098 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.721079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-664cd9c55b-hvdjv"]
Sep 10 11:15:27.818276 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:15:27.818238    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fc7c18_e7d6_45dd_a6db_a0d04f54cc97.slice/crio-e0fe21642bda206b02032ca2e7c46e9d7c51dff5d9823cd2af90770d708cc545 WatchSource:0}: Error finding container e0fe21642bda206b02032ca2e7c46e9d7c51dff5d9823cd2af90770d708cc545: Status 404 returned error can't find the container with id e0fe21642bda206b02032ca2e7c46e9d7c51dff5d9823cd2af90770d708cc545
Sep 10 11:15:27.819255 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.819143    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc"]
Sep 10 11:15:27.819897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.819877    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55c4b57f5-g4tjz"]
Sep 10 11:15:27.836788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.836767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-stats-auth\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.836866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.836792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.836866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.836833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-default-certificate\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.836942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.836897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmnzh\" (UniqueName: \"kubernetes.io/projected/9e1c0235-f667-482e-9f74-d827f103045a-kube-api-access-gmnzh\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.836942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.836925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.839865 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.839846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.846007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.845920    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ddwrf\""
Sep 10 11:15:27.846007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.845944    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 11:15:27.846219 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.846200    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 11:15:27.846462 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.846447    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 11:15:27.851669 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.851653    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 11:15:27.870028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.870006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55c4b57f5-g4tjz"]
Sep 10 11:15:27.938216 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-certificates\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938216 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bttkd\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-kube-api-access-bttkd\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-installation-pull-secrets\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-default-certificate\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.938361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmnzh\" (UniqueName: \"kubernetes.io/projected/9e1c0235-f667-482e-9f74-d827f103045a-kube-api-access-gmnzh\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.938361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.938621 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:27.938421    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:28.438399938 +0000 UTC m=+52.532601590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : configmap references non-existent config key: service-ca.crt
Sep 10 11:15:27.938621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-trusted-ca\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-image-registry-private-configuration\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-bound-sa-token\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938877 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-ca-trust-extracted\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:27.938877 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-stats-auth\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.938877 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.938710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.938877 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:27.938825    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 11:15:27.939096 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:27.938891    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:28.438873963 +0000 UTC m=+52.533075616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : secret "router-metrics-certs-default" not found
Sep 10 11:15:27.940947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.940911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-default-certificate\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.940995 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.940982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-stats-auth\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:27.963196 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:27.963174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmnzh\" (UniqueName: \"kubernetes.io/projected/9e1c0235-f667-482e-9f74-d827f103045a-kube-api-access-gmnzh\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:28.039272 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-certificates\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039366 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bttkd\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-kube-api-access-bttkd\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039366 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-installation-pull-secrets\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039366 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-trusted-ca\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039366 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-image-registry-private-configuration\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-bound-sa-token\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-ca-trust-extracted\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.039638 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.039472    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 11:15:28.039638 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.039489    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4b57f5-g4tjz: secret "image-registry-tls" not found
Sep 10 11:15:28.039638 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.039559    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls podName:ad76e5f9-7f04-4a5c-8969-2959b1acbb41 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:28.539519044 +0000 UTC m=+52.633720702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls") pod "image-registry-55c4b57f5-g4tjz" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41") : secret "image-registry-tls" not found
Sep 10 11:15:28.040066 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-ca-trust-extracted\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.040066 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.039931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-certificates\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.040270 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.040254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-trusted-ca\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.041648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.041631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-image-registry-private-configuration\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.041763 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.041745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-installation-pull-secrets\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.102969 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.102948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-bound-sa-token\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.123831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.123812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bttkd\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-kube-api-access-bttkd\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.441746 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.441715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:28.442066 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.441773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:28.442066 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.441860    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 11:15:28.442066 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.441903    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:29.441885882 +0000 UTC m=+53.536087536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : configmap references non-existent config key: service-ca.crt
Sep 10 11:15:28.442066 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.441919    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:29.441912331 +0000 UTC m=+53.536113969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : secret "router-metrics-certs-default" not found
Sep 10 11:15:28.542861 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.542836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:28.542979 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.542942    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 11:15:28.542979 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.542952    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4b57f5-g4tjz: secret "image-registry-tls" not found
Sep 10 11:15:28.543050 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:28.542990    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls podName:ad76e5f9-7f04-4a5c-8969-2959b1acbb41 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:29.542977961 +0000 UTC m=+53.637179600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls") pod "image-registry-55c4b57f5-g4tjz" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41") : secret "image-registry-tls" not found
Sep 10 11:15:28.757942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:28.757900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc" event={"ID":"55fc7c18-e7d6-45dd-a6db-a0d04f54cc97","Type":"ContainerStarted","Data":"e0fe21642bda206b02032ca2e7c46e9d7c51dff5d9823cd2af90770d708cc545"}
Sep 10 11:15:29.450117 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:29.450080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:29.450465 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:29.450144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:29.450465 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:29.450237    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 11:15:29.450465 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:29.450292    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:31.450275898 +0000 UTC m=+55.544477555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : configmap references non-existent config key: service-ca.crt
Sep 10 11:15:29.450465 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:29.450329    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:31.450314242 +0000 UTC m=+55.544515958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : secret "router-metrics-certs-default" not found
Sep 10 11:15:29.550639 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:29.550609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:29.550768 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:29.550708    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 11:15:29.550768 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:29.550720    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4b57f5-g4tjz: secret "image-registry-tls" not found
Sep 10 11:15:29.550768 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:29.550758    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls podName:ad76e5f9-7f04-4a5c-8969-2959b1acbb41 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:31.5507469 +0000 UTC m=+55.644948552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls") pod "image-registry-55c4b57f5-g4tjz" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41") : secret "image-registry-tls" not found
Sep 10 11:15:29.761325 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:29.761289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc" event={"ID":"55fc7c18-e7d6-45dd-a6db-a0d04f54cc97","Type":"ContainerStarted","Data":"364235d6821906488bc26cbc49f85343ba0cff5f6b771d384ece32d807210bb2"}
Sep 10 11:15:29.786467 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:29.786425    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cc5qc" podStartSLOduration=1.031672652 podStartE2EDuration="2.786410414s" totalImagesPullingTime="1.754737762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:29.785973616 +0000 UTC m=+53.880175277" watchObservedRunningTime="2026-09-10 11:15:29.786410414 +0000 UTC m=+53.880612064"
Sep 10 11:15:31.465727 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:31.465693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:31.466114 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:31.465756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:31.466114 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:31.465840    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:35.465824742 +0000 UTC m=+59.560026381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : configmap references non-existent config key: service-ca.crt
Sep 10 11:15:31.466114 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:31.465847    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 11:15:31.466114 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:31.465888    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:35.465876171 +0000 UTC m=+59.560077809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : secret "router-metrics-certs-default" not found
Sep 10 11:15:31.566746 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:31.566720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:31.566885 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:31.566824    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 11:15:31.566885 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:31.566838    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4b57f5-g4tjz: secret "image-registry-tls" not found
Sep 10 11:15:31.566993 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:31.566889    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls podName:ad76e5f9-7f04-4a5c-8969-2959b1acbb41 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:35.566874211 +0000 UTC m=+59.661075863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls") pod "image-registry-55c4b57f5-g4tjz" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41") : secret "image-registry-tls" not found
Sep 10 11:15:32.094619 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.094583    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gzw4r"]
Sep 10 11:15:32.096789 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.096766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.100667 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.100642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 11:15:32.100779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.100719    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 11:15:32.100779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.100763    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 11:15:32.100894 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.100804    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tf5wn\""
Sep 10 11:15:32.101690 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.101672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 11:15:32.116576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.116546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gzw4r"]
Sep 10 11:15:32.271258 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.271228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af3eb8cb-e235-4be2-95d9-1c6bb135c392-data-volume\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.271360 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.271273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af3eb8cb-e235-4be2-95d9-1c6bb135c392-crio-socket\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.271410 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.271351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.271410 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.271384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.271485 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.271445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8d85\" (UniqueName: \"kubernetes.io/projected/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-api-access-k8d85\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.371835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.371768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.371835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.371810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.371983 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.371877    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 11:15:32.371983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.371888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8d85\" (UniqueName: \"kubernetes.io/projected/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-api-access-k8d85\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.371983 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.371955    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:32.871934284 +0000 UTC m=+56.966135931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : configmap "kube-rbac-proxy" not found
Sep 10 11:15:32.371983 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.371971    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:32.372171 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.372020    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:32.872006641 +0000 UTC m=+56.966208280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:32.372171 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.372038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af3eb8cb-e235-4be2-95d9-1c6bb135c392-data-volume\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.372171 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.372065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af3eb8cb-e235-4be2-95d9-1c6bb135c392-crio-socket\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.372171 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.372120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af3eb8cb-e235-4be2-95d9-1c6bb135c392-crio-socket\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.372311 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.372293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af3eb8cb-e235-4be2-95d9-1c6bb135c392-data-volume\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.385728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.385709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8d85\" (UniqueName: \"kubernetes.io/projected/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-api-access-k8d85\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.876021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.875990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.876385 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:32.876024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:32.876385 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.876126    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 11:15:32.876385 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.876191    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:33.876173819 +0000 UTC m=+57.970375479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : configmap "kube-rbac-proxy" not found
Sep 10 11:15:32.876385 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.876193    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:32.876385 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:32.876236    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:33.876226432 +0000 UTC m=+57.970428070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:33.882373 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:33.882335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:33.882373 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:33.882376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:33.882872 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:33.882458    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 11:15:33.882872 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:33.882483    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:33.882872 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:33.882520    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:35.882504693 +0000 UTC m=+59.976706331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : configmap "kube-rbac-proxy" not found
Sep 10 11:15:33.882872 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:33.882554    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:35.88254443 +0000 UTC m=+59.976746081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:33.948143 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:33.948119    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cfmkf_06e98cfd-1f49-4a66-b727-8d91d2c64913/dns-node-resolver/0.log"
Sep 10 11:15:35.147951 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.147920    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w2fx8_9606b213-0b2a-436d-be69-c0666cc75f1f/node-ca/0.log"
Sep 10 11:15:35.495904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.495869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:35.496095 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.495940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:35.496095 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.496049    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 11:15:35.496095 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.496076    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:43.496055616 +0000 UTC m=+67.590257258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : configmap references non-existent config key: service-ca.crt
Sep 10 11:15:35.496217 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.496114    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:43.496098461 +0000 UTC m=+67.590300198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : secret "router-metrics-certs-default" not found
Sep 10 11:15:35.596695 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.596663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:35.596841 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.596786    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 11:15:35.596841 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.596802    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4b57f5-g4tjz: secret "image-registry-tls" not found
Sep 10 11:15:35.596956 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.596856    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls podName:ad76e5f9-7f04-4a5c-8969-2959b1acbb41 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:43.596840544 +0000 UTC m=+67.691042217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls") pod "image-registry-55c4b57f5-g4tjz" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41") : secret "image-registry-tls" not found
Sep 10 11:15:35.898994 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.898931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:35.899111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.899056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:35.899111 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.899075    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:35.899188 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.899124    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:39.899112297 +0000 UTC m=+63.993313936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:35.899188 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.899122    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 11:15:35.899188 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:35.899164    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:39.899153397 +0000 UTC m=+63.993355071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : configmap "kube-rbac-proxy" not found
Sep 10 11:15:35.948734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:35.948714    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9p7nx_0e7eab7c-03a7-472d-93ba-083772a05e1a/serve-healthcheck-canary/0.log"
Sep 10 11:15:36.691477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:36.691454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkm6h"
Sep 10 11:15:39.928034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:39.927989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:39.928034 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:39.928037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:39.931956 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:39.928119    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 11:15:39.931956 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:39.928156    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:39.931956 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:39.928187    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:47.928169981 +0000 UTC m=+72.022371619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : configmap "kube-rbac-proxy" not found
Sep 10 11:15:39.931956 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:39.928210    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:47.92819697 +0000 UTC m=+72.022398608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:40.199427 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.199365    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hnxsj"]
Sep 10 11:15:40.201728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.201712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.212917 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:40.212894    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"signing-key\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"signing-key\"" type="*v1.Secret"
Sep 10 11:15:40.212998 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:40.212895    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"signing-cabundle\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" type="*v1.ConfigMap"
Sep 10 11:15:40.212998 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:40.212921    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"service-ca-75d99c484-hnxsj\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" podUID="a103d182-6580-4516-8362-707c5645657a" pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.213065 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:40.213026    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 10 11:15:40.213065 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:40.213031    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-dockercfg-cpntd\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cpntd\"" type="*v1.Secret"
Sep 10 11:15:40.213065 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:40.213033    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 10 11:15:40.238686 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.238664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hnxsj"]
Sep 10 11:15:40.330824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.330803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a103d182-6580-4516-8362-707c5645657a-signing-cabundle\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.330942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.330869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a103d182-6580-4516-8362-707c5645657a-signing-key\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.330942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.330888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpg4j\" (UniqueName: \"kubernetes.io/projected/a103d182-6580-4516-8362-707c5645657a-kube-api-access-qpg4j\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.431563 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.431522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a103d182-6580-4516-8362-707c5645657a-signing-cabundle\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.431655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.431636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a103d182-6580-4516-8362-707c5645657a-signing-key\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:40.431702 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:40.431658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpg4j\" (UniqueName: \"kubernetes.io/projected/a103d182-6580-4516-8362-707c5645657a-kube-api-access-qpg4j\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:41.380180 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.380150    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cpntd\""
Sep 10 11:15:41.403787 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.403768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 11:15:41.414960 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.414930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a103d182-6580-4516-8362-707c5645657a-signing-key\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:41.432093 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:41.432074    2580 configmap.go:193] Couldn't get configMap openshift-service-ca/signing-cabundle: failed to sync configmap cache: timed out waiting for the condition
Sep 10 11:15:41.432167 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:41.432142    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a103d182-6580-4516-8362-707c5645657a-signing-cabundle podName:a103d182-6580-4516-8362-707c5645657a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:41.932127762 +0000 UTC m=+66.026329404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "signing-cabundle" (UniqueName: "kubernetes.io/configmap/a103d182-6580-4516-8362-707c5645657a-signing-cabundle") pod "service-ca-75d99c484-hnxsj" (UID: "a103d182-6580-4516-8362-707c5645657a") : failed to sync configmap cache: timed out waiting for the condition
Sep 10 11:15:41.445715 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:41.445695    2580 projected.go:291] Couldn't get configMap openshift-service-ca/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 10 11:15:41.510901 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.510879    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 11:15:41.748942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.748913    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 11:15:41.796114 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.796090    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 11:15:41.806541 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:41.806515    2580 projected.go:196] Error preparing data for projected volume kube-api-access-qpg4j for pod openshift-service-ca/service-ca-75d99c484-hnxsj: failed to sync configmap cache: timed out waiting for the condition
Sep 10 11:15:41.806613 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:41.806603    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a103d182-6580-4516-8362-707c5645657a-kube-api-access-qpg4j podName:a103d182-6580-4516-8362-707c5645657a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:42.306586442 +0000 UTC m=+66.400788080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qpg4j" (UniqueName: "kubernetes.io/projected/a103d182-6580-4516-8362-707c5645657a-kube-api-access-qpg4j") pod "service-ca-75d99c484-hnxsj" (UID: "a103d182-6580-4516-8362-707c5645657a") : failed to sync configmap cache: timed out waiting for the condition
Sep 10 11:15:41.945520 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.945495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a103d182-6580-4516-8362-707c5645657a-signing-cabundle\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:41.946571 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:41.946552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a103d182-6580-4516-8362-707c5645657a-signing-cabundle\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:42.146561 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.146480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:15:42.146561 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.146512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:42.146659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.146589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:42.151269 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.151251    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 11:15:42.151416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.151401    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 11:15:42.151498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.151481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 11:15:42.157167 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:42.157139    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 11:15:42.157284 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:42.157199    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs podName:39c5cd93-7314-4cc8-a29d-5fc3203988ee nodeName:}" failed. No retries permitted until 2026-09-10 11:16:46.157184198 +0000 UTC m=+130.251385841 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs") pod "network-metrics-daemon-x2kg2" (UID: "39c5cd93-7314-4cc8-a29d-5fc3203988ee") : secret "metrics-daemon-secret" not found
Sep 10 11:15:42.159362 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.159339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54710b21-c748-4242-b8fc-384aae38a017-original-pull-secret\") pod \"global-pull-secret-syncer-fr9t7\" (UID: \"54710b21-c748-4242-b8fc-384aae38a017\") " pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:42.160006 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.159989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 11:15:42.169498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.169476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkqr\" (UniqueName: \"kubernetes.io/projected/85b44cfe-cf83-4378-9eea-85e738d47d51-kube-api-access-xhkqr\") pod \"network-check-target-9x6rr\" (UID: \"85b44cfe-cf83-4378-9eea-85e738d47d51\") " pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:42.331476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.331445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fr9t7"
Sep 10 11:15:42.340013 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.339995    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7sc2\""
Sep 10 11:15:42.347660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.347644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:42.349088 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.349063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpg4j\" (UniqueName: \"kubernetes.io/projected/a103d182-6580-4516-8362-707c5645657a-kube-api-access-qpg4j\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:42.351426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.351408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpg4j\" (UniqueName: \"kubernetes.io/projected/a103d182-6580-4516-8362-707c5645657a-kube-api-access-qpg4j\") pod \"service-ca-75d99c484-hnxsj\" (UID: \"a103d182-6580-4516-8362-707c5645657a\") " pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:42.610287 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.610248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hnxsj"
Sep 10 11:15:42.611911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.611887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fr9t7"]
Sep 10 11:15:42.617717 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:15:42.617686    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54710b21_c748_4242_b8fc_384aae38a017.slice/crio-efea0ecd748cf7aff2e66cc3e3ec6cd70baadae5d4b795bf284bb55bff9bcd5b WatchSource:0}: Error finding container efea0ecd748cf7aff2e66cc3e3ec6cd70baadae5d4b795bf284bb55bff9bcd5b: Status 404 returned error can't find the container with id efea0ecd748cf7aff2e66cc3e3ec6cd70baadae5d4b795bf284bb55bff9bcd5b
Sep 10 11:15:42.630101 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.630077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9x6rr"]
Sep 10 11:15:42.634309 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:15:42.634276    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b44cfe_cf83_4378_9eea_85e738d47d51.slice/crio-f8343e87570a3fc949625312172bd97e5f4a424d5c21460590fb2fc14ee2769a WatchSource:0}: Error finding container f8343e87570a3fc949625312172bd97e5f4a424d5c21460590fb2fc14ee2769a: Status 404 returned error can't find the container with id f8343e87570a3fc949625312172bd97e5f4a424d5c21460590fb2fc14ee2769a
Sep 10 11:15:42.792544 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.792494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9x6rr" event={"ID":"85b44cfe-cf83-4378-9eea-85e738d47d51","Type":"ContainerStarted","Data":"f8343e87570a3fc949625312172bd97e5f4a424d5c21460590fb2fc14ee2769a"}
Sep 10 11:15:42.793594 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.793575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fr9t7" event={"ID":"54710b21-c748-4242-b8fc-384aae38a017","Type":"ContainerStarted","Data":"efea0ecd748cf7aff2e66cc3e3ec6cd70baadae5d4b795bf284bb55bff9bcd5b"}
Sep 10 11:15:42.894679 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:42.894657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hnxsj"]
Sep 10 11:15:42.897910 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:15:42.897886    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda103d182_6580_4516_8362_707c5645657a.slice/crio-52da1aa85564fdff0a6ccda0ae87f682fe13f7cf25b0e2fce887848b6d3ff713 WatchSource:0}: Error finding container 52da1aa85564fdff0a6ccda0ae87f682fe13f7cf25b0e2fce887848b6d3ff713: Status 404 returned error can't find the container with id 52da1aa85564fdff0a6ccda0ae87f682fe13f7cf25b0e2fce887848b6d3ff713
Sep 10 11:15:43.357236 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:43.357202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:15:43.357411 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.357370    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 11:15:43.357478 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.357450    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls podName:5f0d4662-dcb8-480e-ab30-3464b4e8f41d nodeName:}" failed. No retries permitted until 2026-09-10 11:16:15.357426513 +0000 UTC m=+99.451628167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls") pod "dns-default-qgbm6" (UID: "5f0d4662-dcb8-480e-ab30-3464b4e8f41d") : secret "dns-default-metrics-tls" not found
Sep 10 11:15:43.559204 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:43.559167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:43.559370 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:43.559269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:43.559370 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.559333    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 11:15:43.559475 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.559375    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:59.55936156 +0000 UTC m=+83.653563211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : configmap references non-existent config key: service-ca.crt
Sep 10 11:15:43.559475 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.559390    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs podName:9e1c0235-f667-482e-9f74-d827f103045a nodeName:}" failed. No retries permitted until 2026-09-10 11:15:59.559383797 +0000 UTC m=+83.653585434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs") pod "router-default-664cd9c55b-hvdjv" (UID: "9e1c0235-f667-482e-9f74-d827f103045a") : secret "router-metrics-certs-default" not found
Sep 10 11:15:43.660476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:43.660364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:43.660916 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.660523    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 11:15:43.660916 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.660560    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4b57f5-g4tjz: secret "image-registry-tls" not found
Sep 10 11:15:43.660916 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:43.660620    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls podName:ad76e5f9-7f04-4a5c-8969-2959b1acbb41 nodeName:}" failed. No retries permitted until 2026-09-10 11:15:59.66060214 +0000 UTC m=+83.754803794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls") pod "image-registry-55c4b57f5-g4tjz" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41") : secret "image-registry-tls" not found
Sep 10 11:15:43.798267 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:43.798228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hnxsj" event={"ID":"a103d182-6580-4516-8362-707c5645657a","Type":"ContainerStarted","Data":"52da1aa85564fdff0a6ccda0ae87f682fe13f7cf25b0e2fce887848b6d3ff713"}
Sep 10 11:15:47.998838 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:47.998799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:47.999349 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:47.998852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:47.999349 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:47.998982    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:47.999349 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:15:47.999047    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls podName:af3eb8cb-e235-4be2-95d9-1c6bb135c392 nodeName:}" failed. No retries permitted until 2026-09-10 11:16:03.999033044 +0000 UTC m=+88.093234681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzw4r" (UID: "af3eb8cb-e235-4be2-95d9-1c6bb135c392") : secret "insights-runtime-extractor-tls" not found
Sep 10 11:15:47.999609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:47.999362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af3eb8cb-e235-4be2-95d9-1c6bb135c392-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:15:48.814123 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:48.814085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9x6rr" event={"ID":"85b44cfe-cf83-4378-9eea-85e738d47d51","Type":"ContainerStarted","Data":"57712a34d62416bef1fca98f0bac40c92cb23714a5c9eb98914ee9e792abece7"}
Sep 10 11:15:48.814277 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:48.814197    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:15:48.815852 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:48.815826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fr9t7" event={"ID":"54710b21-c748-4242-b8fc-384aae38a017","Type":"ContainerStarted","Data":"15fd1c0d71a793d3bfb59c89cd81aa4e11dc5cd41af526a474718e980c8c8b28"}
Sep 10 11:15:48.817494 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:48.817468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hnxsj" event={"ID":"a103d182-6580-4516-8362-707c5645657a","Type":"ContainerStarted","Data":"1896f0c369bf6c989c3b6b98ede931fbbcde4a532a66279b817ee6dcdbe04333"}
Sep 10 11:15:48.836876 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:48.836817    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9x6rr" podStartSLOduration=66.959695598 podStartE2EDuration="1m12.836801019s" totalImagesPullingTime="5.877105421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:48.83582629 +0000 UTC m=+72.930027949" watchObservedRunningTime="2026-09-10 11:15:48.836801019 +0000 UTC m=+72.931002680"
Sep 10 11:15:48.855240 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:48.855173    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fr9t7" podStartSLOduration=66.950491643 podStartE2EDuration="1m12.855162146s" totalImagesPullingTime="5.904670503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:48.854697223 +0000 UTC m=+72.948898883" watchObservedRunningTime="2026-09-10 11:15:48.855162146 +0000 UTC m=+72.949363805"
Sep 10 11:15:59.586662 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.586549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:59.586662 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.586607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:59.587294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.587271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1c0235-f667-482e-9f74-d827f103045a-service-ca-bundle\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:59.589037 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.589020    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e1c0235-f667-482e-9f74-d827f103045a-metrics-certs\") pod \"router-default-664cd9c55b-hvdjv\" (UID: \"9e1c0235-f667-482e-9f74-d827f103045a\") " pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:59.687067 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.687043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:59.689401 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.689375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"image-registry-55c4b57f5-g4tjz\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") " pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:15:59.817958 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.817934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bxzls\""
Sep 10 11:15:59.825826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.825807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:15:59.951481 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.951448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ddwrf\""
Sep 10 11:15:59.959202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:15:59.959183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:16:00.110660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.110606    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-hnxsj" podStartSLOduration=14.49597883 podStartE2EDuration="20.110583886s" totalImagesPullingTime="5.614605056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:15:48.882989684 +0000 UTC m=+72.977191344" watchObservedRunningTime="2026-09-10 11:16:00.110583886 +0000 UTC m=+84.204785546"
Sep 10 11:16:00.111038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.111021    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-664cd9c55b-hvdjv"]
Sep 10 11:16:00.113991 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:00.113968    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1c0235_f667_482e_9f74_d827f103045a.slice/crio-8f7ece8a68245859c89b7a089d35403305afabf397e6b28ff0055bbf1d332619 WatchSource:0}: Error finding container 8f7ece8a68245859c89b7a089d35403305afabf397e6b28ff0055bbf1d332619: Status 404 returned error can't find the container with id 8f7ece8a68245859c89b7a089d35403305afabf397e6b28ff0055bbf1d332619
Sep 10 11:16:00.239626 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.239601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55c4b57f5-g4tjz"]
Sep 10 11:16:00.243297 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:00.243265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad76e5f9_7f04_4a5c_8969_2959b1acbb41.slice/crio-fa12a3e863684ff6029b3fa1e854d39161b9416b70b8cbca4814ed8ab5a38439 WatchSource:0}: Error finding container fa12a3e863684ff6029b3fa1e854d39161b9416b70b8cbca4814ed8ab5a38439: Status 404 returned error can't find the container with id fa12a3e863684ff6029b3fa1e854d39161b9416b70b8cbca4814ed8ab5a38439
Sep 10 11:16:00.853875 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.853836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz" event={"ID":"ad76e5f9-7f04-4a5c-8969-2959b1acbb41","Type":"ContainerStarted","Data":"74673181e11a0c2862636d4b0a5266dc3de52b2a841829049363f0b149b28715"}
Sep 10 11:16:00.854293 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.853912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz" event={"ID":"ad76e5f9-7f04-4a5c-8969-2959b1acbb41","Type":"ContainerStarted","Data":"fa12a3e863684ff6029b3fa1e854d39161b9416b70b8cbca4814ed8ab5a38439"}
Sep 10 11:16:00.854293 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.853933    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:16:00.855364 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.855340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-664cd9c55b-hvdjv" event={"ID":"9e1c0235-f667-482e-9f74-d827f103045a","Type":"ContainerStarted","Data":"a03a2ef1f3613f72368ca953e1102bd2ab1fb58023a35fb4403af5b9be53620e"}
Sep 10 11:16:00.855460 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.855375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-664cd9c55b-hvdjv" event={"ID":"9e1c0235-f667-482e-9f74-d827f103045a","Type":"ContainerStarted","Data":"8f7ece8a68245859c89b7a089d35403305afabf397e6b28ff0055bbf1d332619"}
Sep 10 11:16:00.893946 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.893907    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz" podStartSLOduration=33.893894695 podStartE2EDuration="33.893894695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:00.893572932 +0000 UTC m=+84.987774592" watchObservedRunningTime="2026-09-10 11:16:00.893894695 +0000 UTC m=+84.988096354"
Sep 10 11:16:00.927709 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:00.927666    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-664cd9c55b-hvdjv" podStartSLOduration=33.927653952 podStartE2EDuration="33.927653952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:00.927276812 +0000 UTC m=+85.021478472" watchObservedRunningTime="2026-09-10 11:16:00.927653952 +0000 UTC m=+85.021855613"
Sep 10 11:16:01.401233 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.401207    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55c4b57f5-g4tjz"]
Sep 10 11:16:01.558072 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.558045    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5984f796bf-ml4mt"]
Sep 10 11:16:01.564041 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.564014    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.597524 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.597502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5984f796bf-ml4mt"]
Sep 10 11:16:01.702074 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-installation-pull-secrets\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-trusted-ca\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-bound-sa-token\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702264 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-image-registry-private-configuration\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702264 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-registry-tls\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702264 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vdh\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-kube-api-access-d8vdh\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702363 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-registry-certificates\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.702363 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.702285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-ca-trust-extracted\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803305 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-trusted-ca\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803437 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-bound-sa-token\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803437 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-image-registry-private-configuration\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803437 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-registry-tls\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803437 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vdh\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-kube-api-access-d8vdh\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803661 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-registry-certificates\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803661 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-ca-trust-extracted\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803772 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-installation-pull-secrets\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.803999 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.803971    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-ca-trust-extracted\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.804344 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.804323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-registry-certificates\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.804585 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.804561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-trusted-ca\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.806005 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.805976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-registry-tls\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.806087 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.806031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-installation-pull-secrets\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.806125 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.806093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-image-registry-private-configuration\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.826174 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.826151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:16:01.828654 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.828635    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:16:01.836294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.836275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vdh\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-kube-api-access-d8vdh\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.845400 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.845379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac-bound-sa-token\") pod \"image-registry-5984f796bf-ml4mt\" (UID: \"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac\") " pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:01.858857 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.858836    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:16:01.859827 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.859810    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-664cd9c55b-hvdjv"
Sep 10 11:16:01.872104 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:01.872086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:02.159248 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:02.159224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5984f796bf-ml4mt"]
Sep 10 11:16:02.160546 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:02.160503    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bc96fd_c39f_4e93_abd9_5d83fdbb2fac.slice/crio-cc314e35e3c51b2e936b80e1479303c28c58fb0500a548ff6c92c6140b4b06d7 WatchSource:0}: Error finding container cc314e35e3c51b2e936b80e1479303c28c58fb0500a548ff6c92c6140b4b06d7: Status 404 returned error can't find the container with id cc314e35e3c51b2e936b80e1479303c28c58fb0500a548ff6c92c6140b4b06d7
Sep 10 11:16:02.863648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:02.863604    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt" event={"ID":"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac","Type":"ContainerStarted","Data":"3a5901564fc3016d1388ea0f9aece2502b516f5c61e7df5350fa34dec739607e"}
Sep 10 11:16:02.864027 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:02.863688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt" event={"ID":"b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac","Type":"ContainerStarted","Data":"cc314e35e3c51b2e936b80e1479303c28c58fb0500a548ff6c92c6140b4b06d7"}
Sep 10 11:16:02.864027 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:02.863893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:03.064128 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:03.064080    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt" podStartSLOduration=2.064065942 podStartE2EDuration="2.064065942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:03.056216925 +0000 UTC m=+87.150418584" watchObservedRunningTime="2026-09-10 11:16:03.064065942 +0000 UTC m=+87.158267622"
Sep 10 11:16:04.021153 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.021116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:16:04.023604 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.023586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af3eb8cb-e235-4be2-95d9-1c6bb135c392-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzw4r\" (UID: \"af3eb8cb-e235-4be2-95d9-1c6bb135c392\") " pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:16:04.208652 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.208624    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tf5wn\""
Sep 10 11:16:04.216031 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.216012    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gzw4r"
Sep 10 11:16:04.548145 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.548109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gzw4r"]
Sep 10 11:16:04.560119 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:04.560098    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3eb8cb_e235_4be2_95d9_1c6bb135c392.slice/crio-1ac06d185d4646c196a35e5cb979529ed2bd42324dd9a6abaedf6df467c94324 WatchSource:0}: Error finding container 1ac06d185d4646c196a35e5cb979529ed2bd42324dd9a6abaedf6df467c94324: Status 404 returned error can't find the container with id 1ac06d185d4646c196a35e5cb979529ed2bd42324dd9a6abaedf6df467c94324
Sep 10 11:16:04.871627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.871558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzw4r" event={"ID":"af3eb8cb-e235-4be2-95d9-1c6bb135c392","Type":"ContainerStarted","Data":"0105ebcfee25f4472caafcb4535be968d825a057bc0342c11e5b658e03c8e3d0"}
Sep 10 11:16:04.871627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:04.871613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzw4r" event={"ID":"af3eb8cb-e235-4be2-95d9-1c6bb135c392","Type":"ContainerStarted","Data":"1ac06d185d4646c196a35e5cb979529ed2bd42324dd9a6abaedf6df467c94324"}
Sep 10 11:16:05.880712 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:05.880674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzw4r" event={"ID":"af3eb8cb-e235-4be2-95d9-1c6bb135c392","Type":"ContainerStarted","Data":"aa068780d92755a1bff111e9080cfb0bca12ab86ffdfb82bc1dd3772feb144ac"}
Sep 10 11:16:07.889350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:07.889308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzw4r" event={"ID":"af3eb8cb-e235-4be2-95d9-1c6bb135c392","Type":"ContainerStarted","Data":"06678392be8a1baa65df94d3eb3762422a9fd82b739dd8395259877e8875cfba"}
Sep 10 11:16:07.923661 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:07.923612    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gzw4r" podStartSLOduration=33.587900796 podStartE2EDuration="35.923595805s" totalImagesPullingTime="2.335695009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:15:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:07.920259368 +0000 UTC m=+92.014461027" watchObservedRunningTime="2026-09-10 11:16:07.923595805 +0000 UTC m=+92.017797465"
Sep 10 11:16:15.394002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:15.393949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:16:15.396499 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:15.396478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f0d4662-dcb8-480e-ab30-3464b4e8f41d-metrics-tls\") pod \"dns-default-qgbm6\" (UID: \"5f0d4662-dcb8-480e-ab30-3464b4e8f41d\") " pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:16:15.655743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:15.655713    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krm6r\""
Sep 10 11:16:15.662241 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:15.662219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:16:15.935030 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:15.934958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgbm6"]
Sep 10 11:16:15.937426 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:15.937399    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0d4662_dcb8_480e_ab30_3464b4e8f41d.slice/crio-43ee62c451ebc3f3a1b51f5753bf849679c79def02558b1ac2faa3731387a245 WatchSource:0}: Error finding container 43ee62c451ebc3f3a1b51f5753bf849679c79def02558b1ac2faa3731387a245: Status 404 returned error can't find the container with id 43ee62c451ebc3f3a1b51f5753bf849679c79def02558b1ac2faa3731387a245
Sep 10 11:16:16.921000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:16.920957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgbm6" event={"ID":"5f0d4662-dcb8-480e-ab30-3464b4e8f41d","Type":"ContainerStarted","Data":"43ee62c451ebc3f3a1b51f5753bf849679c79def02558b1ac2faa3731387a245"}
Sep 10 11:16:17.720149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.720115    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"]
Sep 10 11:16:17.737986 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.737950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.743740 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.743709    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"]
Sep 10 11:16:17.756869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.755077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 11:16:17.756869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.755341    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 11:16:17.756869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.755501    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 11:16:17.756869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.755694    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 11:16:17.756869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.755928    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rsz9x\""
Sep 10 11:16:17.756869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.756135    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 11:16:17.770291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.769040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"]
Sep 10 11:16:17.784080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.784014    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.788186 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.786960    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-29dkv"]
Sep 10 11:16:17.791925 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.791497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 11:16:17.792027 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.791931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bmt2x\""
Sep 10 11:16:17.793148 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.792108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 11:16:17.793148 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.792611    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 11:16:17.809004 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.803839    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"]
Sep 10 11:16:17.809004 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.803966    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.812996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.812405    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 11:16:17.812996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.812627    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 11:16:17.812996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.812682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cd9j5\""
Sep 10 11:16:17.812996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.812832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 11:16:17.818594 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.818570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.818709 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.818637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7ef078-963f-4b10-8593-92c5a9530731-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.818709 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.818684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.818816 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.818710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4rj\" (UniqueName: \"kubernetes.io/projected/ac7ef078-963f-4b10-8593-92c5a9530731-kube-api-access-fc4rj\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.919073 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-root\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919204 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-accelerators-collector-config\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919204 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/690ab962-165f-46df-b274-fe427b871438-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.919204 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-sys\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.919376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690ab962-165f-46df-b274-fe427b871438-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.919376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37c48dc5-5744-4020-9d81-fe975db47f23-metrics-client-ca\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn792\" (UniqueName: \"kubernetes.io/projected/690ab962-165f-46df-b274-fe427b871438-kube-api-access-sn792\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.919376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-tls\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-textfile\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7ef078-963f-4b10-8593-92c5a9530731-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tb2\" (UniqueName: \"kubernetes.io/projected/37c48dc5-5744-4020-9d81-fe975db47f23-kube-api-access-z4tb2\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:17.919586 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.919838 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4rj\" (UniqueName: \"kubernetes.io/projected/ac7ef078-963f-4b10-8593-92c5a9530731-kube-api-access-fc4rj\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.919838 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-wtmp\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919838 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.919655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:17.919838 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:16:17.919792    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 11:16:17.919974 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:16:17.919849    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-tls podName:ac7ef078-963f-4b10-8593-92c5a9530731 nodeName:}" failed. No retries permitted until 2026-09-10 11:16:18.41983241 +0000 UTC m=+102.514034054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-6xvkg" (UID: "ac7ef078-963f-4b10-8593-92c5a9530731") : secret "openshift-state-metrics-tls" not found
Sep 10 11:16:17.921243 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.920943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7ef078-963f-4b10-8593-92c5a9530731-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.923551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.923515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:17.933820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:17.933768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4rj\" (UniqueName: \"kubernetes.io/projected/ac7ef078-963f-4b10-8593-92c5a9530731-kube-api-access-fc4rj\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:18.020504 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-root\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.020504 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-accelerators-collector-config\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.020710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/690ab962-165f-46df-b274-fe427b871438-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.020710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-sys\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.020710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690ab962-165f-46df-b274-fe427b871438-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.020710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37c48dc5-5744-4020-9d81-fe975db47f23-metrics-client-ca\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.020710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn792\" (UniqueName: \"kubernetes.io/projected/690ab962-165f-46df-b274-fe427b871438-kube-api-access-sn792\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.020710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-tls\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-textfile\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tb2\" (UniqueName: \"kubernetes.io/projected/37c48dc5-5744-4020-9d81-fe975db47f23-kube-api-access-z4tb2\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-wtmp\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.021021 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.020906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.021601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-root\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:16:18.021649    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:16:18.021710    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-tls podName:37c48dc5-5744-4020-9d81-fe975db47f23 nodeName:}" failed. No retries permitted until 2026-09-10 11:16:18.521691332 +0000 UTC m=+102.615892984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-tls") pod "node-exporter-29dkv" (UID: "37c48dc5-5744-4020-9d81-fe975db47f23") : secret "node-exporter-tls" not found
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.021904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-wtmp\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.022140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-accelerators-collector-config\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.022406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/690ab962-165f-46df-b274-fe427b871438-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.022564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.022484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.024489 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.022749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-textfile\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.024489 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.022766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690ab962-165f-46df-b274-fe427b871438-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.024489 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.022813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37c48dc5-5744-4020-9d81-fe975db47f23-sys\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.024489 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.024304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37c48dc5-5744-4020-9d81-fe975db47f23-metrics-client-ca\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.026638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.026614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.026940 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.026924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.027016 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.026967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/690ab962-165f-46df-b274-fe427b871438-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.033603 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.033561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn792\" (UniqueName: \"kubernetes.io/projected/690ab962-165f-46df-b274-fe427b871438-kube-api-access-sn792\") pod \"kube-state-metrics-74cb57df7-mg5tt\" (UID: \"690ab962-165f-46df-b274-fe427b871438\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.035741 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.035713    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tb2\" (UniqueName: \"kubernetes.io/projected/37c48dc5-5744-4020-9d81-fe975db47f23-kube-api-access-z4tb2\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.100897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.100868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"
Sep 10 11:16:18.417368 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.417346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt"]
Sep 10 11:16:18.424420 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.424397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:18.426892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.426873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ef078-963f-4b10-8593-92c5a9530731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-6xvkg\" (UID: \"ac7ef078-963f-4b10-8593-92c5a9530731\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:18.525080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.525050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-tls\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.527879 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.527854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37c48dc5-5744-4020-9d81-fe975db47f23-node-exporter-tls\") pod \"node-exporter-29dkv\" (UID: \"37c48dc5-5744-4020-9d81-fe975db47f23\") " pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.653855 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.653822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"
Sep 10 11:16:18.716953 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.716927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29dkv"
Sep 10 11:16:18.786466 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.786438    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:16:18.806553 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.806505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.808902 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.808873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:16:18.810121 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810102    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 11:16:18.810299 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 11:16:18.810299 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 11:16:18.810485 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4nvmq\""
Sep 10 11:16:18.810485 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810110    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 11:16:18.811052 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 11:16:18.811052 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810677    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 11:16:18.811052 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810755    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 11:16:18.811052 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.810891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 11:16:18.811294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.811065    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 11:16:18.834570 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:18.834523    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690ab962_165f_46df_b274_fe427b871438.slice/crio-c73f72e4c43558dc1e3e9459adff26bcad15b6cc74442350aa01e2cf5364463e WatchSource:0}: Error finding container c73f72e4c43558dc1e3e9459adff26bcad15b6cc74442350aa01e2cf5364463e: Status 404 returned error can't find the container with id c73f72e4c43558dc1e3e9459adff26bcad15b6cc74442350aa01e2cf5364463e
Sep 10 11:16:18.843970 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:18.843952    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c48dc5_5744_4020_9d81_fe975db47f23.slice/crio-a82ef7cf3b730a27549c6ef8169656a395f280b0ded2f62108e4702c88c5e6ad WatchSource:0}: Error finding container a82ef7cf3b730a27549c6ef8169656a395f280b0ded2f62108e4702c88c5e6ad: Status 404 returned error can't find the container with id a82ef7cf3b730a27549c6ef8169656a395f280b0ded2f62108e4702c88c5e6ad
Sep 10 11:16:18.929168 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929168 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-out\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr42c\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-kube-api-access-mr42c\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.929607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.929518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-web-config\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:18.940805 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.940736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29dkv" event={"ID":"37c48dc5-5744-4020-9d81-fe975db47f23","Type":"ContainerStarted","Data":"a82ef7cf3b730a27549c6ef8169656a395f280b0ded2f62108e4702c88c5e6ad"}
Sep 10 11:16:18.941839 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:18.941814    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt" event={"ID":"690ab962-165f-46df-b274-fe427b871438","Type":"ContainerStarted","Data":"c73f72e4c43558dc1e3e9459adff26bcad15b6cc74442350aa01e2cf5364463e"}
Sep 10 11:16:19.030257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-out\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030495 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030574 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030574 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030676 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr42c\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-kube-api-access-mr42c\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030676 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030676 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030884 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.030884 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.031080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.030995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.031080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.031055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-web-config\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.031080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.031099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.031655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.031633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.033360 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.033224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-out\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.034003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.033975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.034650 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.034404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.034650 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.034610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.034789 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.034654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.034789 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.034696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.035070 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.035050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-web-config\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.035129 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.035114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.036166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.036144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.040767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.040748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr42c\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-kube-api-access-mr42c\") pod \"alertmanager-main-0\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.103262 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.103231    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg"]
Sep 10 11:16:19.116919 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.116903    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:16:19.224126 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:19.224099    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7ef078_963f_4b10_8593_92c5a9530731.slice/crio-0c8603a3285d21af0a43395c3f5aa768d141ed5be91fac1be85af26199742a89 WatchSource:0}: Error finding container 0c8603a3285d21af0a43395c3f5aa768d141ed5be91fac1be85af26199742a89: Status 404 returned error can't find the container with id 0c8603a3285d21af0a43395c3f5aa768d141ed5be91fac1be85af26199742a89
Sep 10 11:16:19.540576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.539970    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:16:19.545989 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:19.545957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda870afc8_7924_4f6a_bd7f_8d85dd151c7b.slice/crio-a6d617b11957f3241c7d62e57d8a212710ff9e05849ea0749a71d028385f6a29 WatchSource:0}: Error finding container a6d617b11957f3241c7d62e57d8a212710ff9e05849ea0749a71d028385f6a29: Status 404 returned error can't find the container with id a6d617b11957f3241c7d62e57d8a212710ff9e05849ea0749a71d028385f6a29
Sep 10 11:16:19.823185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.823110    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9x6rr"
Sep 10 11:16:19.947975 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.947936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"a6d617b11957f3241c7d62e57d8a212710ff9e05849ea0749a71d028385f6a29"}
Sep 10 11:16:19.949911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.949887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg" event={"ID":"ac7ef078-963f-4b10-8593-92c5a9530731","Type":"ContainerStarted","Data":"dd3bbeace0106fa76b5c71508464201ebbf29019f27bab65d1313d7206aa30ed"}
Sep 10 11:16:19.950045 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.949944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg" event={"ID":"ac7ef078-963f-4b10-8593-92c5a9530731","Type":"ContainerStarted","Data":"b3c7f97db3f01cc6d50766739c5f828175d0f495e569d2580cd1bb50f99485ae"}
Sep 10 11:16:19.950045 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.949968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg" event={"ID":"ac7ef078-963f-4b10-8593-92c5a9530731","Type":"ContainerStarted","Data":"0c8603a3285d21af0a43395c3f5aa768d141ed5be91fac1be85af26199742a89"}
Sep 10 11:16:19.951419 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.951393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgbm6" event={"ID":"5f0d4662-dcb8-480e-ab30-3464b4e8f41d","Type":"ContainerStarted","Data":"cb9c808eeae18d966d36a914c3a52ac3976f019e3806244102250a0fdf11993e"}
Sep 10 11:16:19.951518 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.951429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgbm6" event={"ID":"5f0d4662-dcb8-480e-ab30-3464b4e8f41d","Type":"ContainerStarted","Data":"04ec6334a2610bf49876358e9790d578079c2f2404fbb3da82149be865606556"}
Sep 10 11:16:19.951668 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.951656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:16:19.975376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:19.975331    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qgbm6" podStartSLOduration=66.654719531 podStartE2EDuration="1m9.975318158s" totalImagesPullingTime="3.320598627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:19.97410092 +0000 UTC m=+104.068302579" watchObservedRunningTime="2026-09-10 11:16:19.975318158 +0000 UTC m=+104.069519818"
Sep 10 11:16:20.959894 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:20.959821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29dkv" event={"ID":"37c48dc5-5744-4020-9d81-fe975db47f23","Type":"ContainerStarted","Data":"7a3a08446d78dd10764f36205132b52c2edade717db4dc6db297540b7060a2fb"}
Sep 10 11:16:20.963454 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:20.963342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt" event={"ID":"690ab962-165f-46df-b274-fe427b871438","Type":"ContainerStarted","Data":"0fb14deb4287b97c31f24fdba67ff31e64e1b658cfd4c551ab6a5573ed01e1f9"}
Sep 10 11:16:20.963454 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:20.963395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt" event={"ID":"690ab962-165f-46df-b274-fe427b871438","Type":"ContainerStarted","Data":"ca4ddf6740e7007ffa3d2ea7dbbcb2034548772aa6b7f0f46f4948eb52c8abbd"}
Sep 10 11:16:21.876923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.876846    2580 patch_prober.go:28] interesting pod/image-registry-5984f796bf-ml4mt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 11:16:21.876923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.876908    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt" podUID="b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 11:16:21.967486 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.967455    2580 generic.go:356] "Generic (PLEG): container finished" podID="37c48dc5-5744-4020-9d81-fe975db47f23" containerID="7a3a08446d78dd10764f36205132b52c2edade717db4dc6db297540b7060a2fb" exitCode=0
Sep 10 11:16:21.967879 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.967526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29dkv" event={"ID":"37c48dc5-5744-4020-9d81-fe975db47f23","Type":"ContainerDied","Data":"7a3a08446d78dd10764f36205132b52c2edade717db4dc6db297540b7060a2fb"}
Sep 10 11:16:21.969964 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.969936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt" event={"ID":"690ab962-165f-46df-b274-fe427b871438","Type":"ContainerStarted","Data":"8a2b3fb3cfc47ef3e7794b093ff148fae98edaf541676692ec5b63bb5a78b819"}
Sep 10 11:16:21.971475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.971456    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d" exitCode=0
Sep 10 11:16:21.971578 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.971553    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"}
Sep 10 11:16:21.973898 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:21.973877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg" event={"ID":"ac7ef078-963f-4b10-8593-92c5a9530731","Type":"ContainerStarted","Data":"9cd0d8056877f17ba5d5a6b08f137b0c5c9646e4e682e0b797d72bc2c5f5bdbc"}
Sep 10 11:16:22.058077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.058036    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-6xvkg" podStartSLOduration=3.086078392 podStartE2EDuration="5.058020284s" totalImagesPullingTime="1.971941892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:22.021251054 +0000 UTC m=+106.115452714" watchObservedRunningTime="2026-09-10 11:16:22.058020284 +0000 UTC m=+106.152221944"
Sep 10 11:16:22.100940 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.100879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mg5tt" podStartSLOduration=3.294303181 podStartE2EDuration="5.100856625s" totalImagesPullingTime="1.806553444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:22.100218883 +0000 UTC m=+106.194420543" watchObservedRunningTime="2026-09-10 11:16:22.100856625 +0000 UTC m=+106.195058286"
Sep 10 11:16:22.178785 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.178718    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"]
Sep 10 11:16:22.180899 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.180885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.185388 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.185368    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 11:16:22.186056 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.186037    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 11:16:22.186150 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.186042    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 11:16:22.186150 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.186074    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 11:16:22.187006 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.186794    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9nm6rf6i385k7\""
Sep 10 11:16:22.187006 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.186925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7ggrw\""
Sep 10 11:16:22.202698 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.202678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"]
Sep 10 11:16:22.263963 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.263939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-secret-metrics-server-client-certs\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.264058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.263967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hhkl\" (UniqueName: \"kubernetes.io/projected/0961b4eb-2ba2-4699-8b24-fc088cab304f-kube-api-access-8hhkl\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.264058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.263990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0961b4eb-2ba2-4699-8b24-fc088cab304f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.264058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.264018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0961b4eb-2ba2-4699-8b24-fc088cab304f-audit-log\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.264176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.264080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-secret-metrics-server-tls\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.264176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.264117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0961b4eb-2ba2-4699-8b24-fc088cab304f-metrics-server-audit-profiles\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.264176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.264154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-client-ca-bundle\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365249 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-client-ca-bundle\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365372 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-secret-metrics-server-client-certs\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365372 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hhkl\" (UniqueName: \"kubernetes.io/projected/0961b4eb-2ba2-4699-8b24-fc088cab304f-kube-api-access-8hhkl\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365372 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0961b4eb-2ba2-4699-8b24-fc088cab304f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365796 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0961b4eb-2ba2-4699-8b24-fc088cab304f-audit-log\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365796 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-secret-metrics-server-tls\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365796 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0961b4eb-2ba2-4699-8b24-fc088cab304f-metrics-server-audit-profiles\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.365986 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.365855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0961b4eb-2ba2-4699-8b24-fc088cab304f-audit-log\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.366605 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.366577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0961b4eb-2ba2-4699-8b24-fc088cab304f-metrics-server-audit-profiles\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.366704 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.366578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0961b4eb-2ba2-4699-8b24-fc088cab304f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.369588 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.369522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-secret-metrics-server-tls\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.370120 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.370094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-client-ca-bundle\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.372071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.372043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0961b4eb-2ba2-4699-8b24-fc088cab304f-secret-metrics-server-client-certs\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.379093 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.379063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hhkl\" (UniqueName: \"kubernetes.io/projected/0961b4eb-2ba2-4699-8b24-fc088cab304f-kube-api-access-8hhkl\") pod \"metrics-server-5d8bbc85cc-lvttc\" (UID: \"0961b4eb-2ba2-4699-8b24-fc088cab304f\") " pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.489343 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.489313    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:22.771081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.771050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"]
Sep 10 11:16:22.772662 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:22.772634    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0961b4eb_2ba2_4699_8b24_fc088cab304f.slice/crio-13457a8ace2bbf8d682f6be67a827716e6cd1ce4e5edd35babda9f6d2286fb9c WatchSource:0}: Error finding container 13457a8ace2bbf8d682f6be67a827716e6cd1ce4e5edd35babda9f6d2286fb9c: Status 404 returned error can't find the container with id 13457a8ace2bbf8d682f6be67a827716e6cd1ce4e5edd35babda9f6d2286fb9c
Sep 10 11:16:22.869138 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.869112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:16:22.945479 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.945453    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"]
Sep 10 11:16:22.948277 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.948253    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:22.951435 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.951317    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 11:16:22.951435 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.951325    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 11:16:22.952493 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.952464    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 11:16:22.952792 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.952770    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 11:16:22.952930 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.952911    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 11:16:22.954951 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.954825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vjr5b\""
Sep 10 11:16:22.966921 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.966899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 11:16:22.972657 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.972634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"]
Sep 10 11:16:22.980740 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.980710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29dkv" event={"ID":"37c48dc5-5744-4020-9d81-fe975db47f23","Type":"ContainerStarted","Data":"bd1367b316aea33a0e60c4488276986e37158e0a7f0347d3f41170ce0263955a"}
Sep 10 11:16:22.980832 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.980767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29dkv" event={"ID":"37c48dc5-5744-4020-9d81-fe975db47f23","Type":"ContainerStarted","Data":"ce1b482e92e2f09bcf1a21232623e6c45ba0ca2532a0b7e0d74e54a60182a4c5"}
Sep 10 11:16:22.981918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:22.981899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc" event={"ID":"0961b4eb-2ba2-4699-8b24-fc088cab304f","Type":"ContainerStarted","Data":"13457a8ace2bbf8d682f6be67a827716e6cd1ce4e5edd35babda9f6d2286fb9c"}
Sep 10 11:16:23.013320 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.013278    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-29dkv" podStartSLOduration=4.075932067 podStartE2EDuration="6.013264829s" totalImagesPullingTime="1.792557486s" totalInitContainerRuntime="144.775276ms" isStatefulPod=true podCreationTimestamp="2026-09-10 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:23.011671053 +0000 UTC m=+107.105872731" watchObservedRunningTime="2026-09-10 11:16:23.013264829 +0000 UTC m=+107.107466489"
Sep 10 11:16:23.071501 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-secret-telemeter-client\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.071744 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2kh\" (UniqueName: \"kubernetes.io/projected/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-kube-api-access-cl2kh\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.071744 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-serving-certs-ca-bundle\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.071744 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.071981 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-metrics-client-ca\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.071981 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.071981 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.071913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-telemeter-client-tls\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.072137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.072086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-federate-client-tls\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.173790 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-federate-client-tls\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.173918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-secret-telemeter-client\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.173918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2kh\" (UniqueName: \"kubernetes.io/projected/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-kube-api-access-cl2kh\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.173918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-serving-certs-ca-bundle\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.173918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.173918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-metrics-client-ca\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.174181 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.174181 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.173949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-telemeter-client-tls\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.174711 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.174685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-serving-certs-ca-bundle\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.175184 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.175116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-metrics-client-ca\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.175301 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.175223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.177282 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.176933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-federate-client-tls\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.177282 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.177047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-telemeter-client-tls\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.177282 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.177157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-secret-telemeter-client\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.177282 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.177229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.183913 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.183892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2kh\" (UniqueName: \"kubernetes.io/projected/63cf7106-48f8-44d0-9ef3-bbfaf1d498db-kube-api-access-cl2kh\") pod \"telemeter-client-7f7bd7995b-hlfzk\" (UID: \"63cf7106-48f8-44d0-9ef3-bbfaf1d498db\") " pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.261475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.261448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"
Sep 10 11:16:23.551458 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.551433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk"]
Sep 10 11:16:23.746269 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:23.746241    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cf7106_48f8_44d0_9ef3_bbfaf1d498db.slice/crio-c18046c1a338e904c49166d626946a1386566b1fe81ea1bd59088d24a6664fe3 WatchSource:0}: Error finding container c18046c1a338e904c49166d626946a1386566b1fe81ea1bd59088d24a6664fe3: Status 404 returned error can't find the container with id c18046c1a338e904c49166d626946a1386566b1fe81ea1bd59088d24a6664fe3
Sep 10 11:16:23.878078 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.877314    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5984f796bf-ml4mt"
Sep 10 11:16:23.987786 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.987755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk" event={"ID":"63cf7106-48f8-44d0-9ef3-bbfaf1d498db","Type":"ContainerStarted","Data":"c18046c1a338e904c49166d626946a1386566b1fe81ea1bd59088d24a6664fe3"}
Sep 10 11:16:23.990337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.990303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"}
Sep 10 11:16:23.990454 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:23.990372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"}
Sep 10 11:16:24.995984 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:24.995942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc" event={"ID":"0961b4eb-2ba2-4699-8b24-fc088cab304f","Type":"ContainerStarted","Data":"26a00a1069437591b9b786cc6ea03efccb057c255626ee806faa9da31ae48d48"}
Sep 10 11:16:24.999482 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:24.999453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"}
Sep 10 11:16:24.999615 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:24.999545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"}
Sep 10 11:16:24.999615 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:24.999590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"}
Sep 10 11:16:25.051505 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:25.051447    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc" podStartSLOduration=1.4918160440000001 podStartE2EDuration="3.051431843s" totalImagesPullingTime="1.559615799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:25.050985559 +0000 UTC m=+109.145187219" watchObservedRunningTime="2026-09-10 11:16:25.051431843 +0000 UTC m=+109.145633502"
Sep 10 11:16:26.008158 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.008115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerStarted","Data":"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"}
Sep 10 11:16:26.047299 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.047238    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.710758068 podStartE2EDuration="8.047221542s" totalImagesPullingTime="4.315279971s" totalInitContainerRuntime="21.183503ms" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:26.047052298 +0000 UTC m=+110.141253958" watchObservedRunningTime="2026-09-10 11:16:26.047221542 +0000 UTC m=+110.141423202"
Sep 10 11:16:26.911771 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.911729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8bdc8768-pbppg"]
Sep 10 11:16:26.914890 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.914872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:26.918941 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.918900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 11:16:26.918941 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.918905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 11:16:26.919118 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.919027    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 11:16:26.920116 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.920099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 11:16:26.920237 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.920219    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 11:16:26.920323 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.920228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 11:16:26.920323 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.920261    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 11:16:26.920323 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.920275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vkdfh\""
Sep 10 11:16:26.927471 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:26.927451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8bdc8768-pbppg"]
Sep 10 11:16:27.010033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.010013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dplh4\" (UniqueName: \"kubernetes.io/projected/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-kube-api-access-dplh4\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.010346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.010063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-oauth-config\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.010346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.010085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-config\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.010346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.010114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-serving-cert\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.010346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.010146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-oauth-serving-cert\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.010346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.010203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-service-ca\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.014580 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.014552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk" event={"ID":"63cf7106-48f8-44d0-9ef3-bbfaf1d498db","Type":"ContainerStarted","Data":"cef623ea92eb8b0493c77231c703868c2c72f73425cf35bb46922f6054c78594"}
Sep 10 11:16:27.014661 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.014613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk" event={"ID":"63cf7106-48f8-44d0-9ef3-bbfaf1d498db","Type":"ContainerStarted","Data":"7714965f14188a8604f03062521242fd0dbefdfdff0a5e758f197f5d2baf405a"}
Sep 10 11:16:27.014661 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.014645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk" event={"ID":"63cf7106-48f8-44d0-9ef3-bbfaf1d498db","Type":"ContainerStarted","Data":"b431ed07a2ff56ea71b1fd4ab7296ec4db31699ec0564194a24b12441c63e9ca"}
Sep 10 11:16:27.043598 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.043555    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f7bd7995b-hlfzk" podStartSLOduration=2.417036773 podStartE2EDuration="5.043525764s" totalImagesPullingTime="2.626488991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:27.041373667 +0000 UTC m=+111.135575326" watchObservedRunningTime="2026-09-10 11:16:27.043525764 +0000 UTC m=+111.137727442"
Sep 10 11:16:27.111440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.111413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-oauth-serving-cert\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.111560 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.111443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-service-ca\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112114 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dplh4\" (UniqueName: \"kubernetes.io/projected/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-kube-api-access-dplh4\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-oauth-config\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-service-ca\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-config\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-oauth-serving-cert\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-serving-cert\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.112950 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.112930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-config\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.114711 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.114690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-oauth-config\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.114863 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.114847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-serving-cert\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.122440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.122422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dplh4\" (UniqueName: \"kubernetes.io/projected/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-kube-api-access-dplh4\") pod \"console-7f8bdc8768-pbppg\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") " pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.223724 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.223700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:27.502222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.502151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8bdc8768-pbppg"]
Sep 10 11:16:27.506317 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:27.506293    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda891cf8a_22d4_4319_b3f5_2ac09cdd27e3.slice/crio-555fb4867e3c6d6e9c707ea6f7dc02edef99bf69ef7ffc0858ce2feec5e47000 WatchSource:0}: Error finding container 555fb4867e3c6d6e9c707ea6f7dc02edef99bf69ef7ffc0858ce2feec5e47000: Status 404 returned error can't find the container with id 555fb4867e3c6d6e9c707ea6f7dc02edef99bf69ef7ffc0858ce2feec5e47000
Sep 10 11:16:27.882820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:27.882733    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz" podUID="ad76e5f9-7f04-4a5c-8969-2959b1acbb41" containerName="registry" containerID="cri-o://74673181e11a0c2862636d4b0a5266dc3de52b2a841829049363f0b149b28715" gracePeriod=30
Sep 10 11:16:28.020223 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.020198    2580 generic.go:356] "Generic (PLEG): container finished" podID="ad76e5f9-7f04-4a5c-8969-2959b1acbb41" containerID="74673181e11a0c2862636d4b0a5266dc3de52b2a841829049363f0b149b28715" exitCode=0
Sep 10 11:16:28.020579 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.020277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz" event={"ID":"ad76e5f9-7f04-4a5c-8969-2959b1acbb41","Type":"ContainerDied","Data":"74673181e11a0c2862636d4b0a5266dc3de52b2a841829049363f0b149b28715"}
Sep 10 11:16:28.021587 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.021567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8bdc8768-pbppg" event={"ID":"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3","Type":"ContainerStarted","Data":"555fb4867e3c6d6e9c707ea6f7dc02edef99bf69ef7ffc0858ce2feec5e47000"}
Sep 10 11:16:28.122276 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.122257    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:16:28.221151 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221128    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221175    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-bound-sa-token\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221213    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bttkd\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-kube-api-access-bttkd\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221253    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-trusted-ca\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221277    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-image-registry-private-configuration\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221306    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-installation-pull-secrets\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221337    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-certificates\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.221576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221395    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-ca-trust-extracted\") pod \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\" (UID: \"ad76e5f9-7f04-4a5c-8969-2959b1acbb41\") "
Sep 10 11:16:28.222009 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.221980    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:16:28.222122 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.222039    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:16:28.224212 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.224175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:16:28.224353 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.224325    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:16:28.224483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.224425    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:16:28.224815 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.224791    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:16:28.225354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.225333    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-kube-api-access-bttkd" (OuterVolumeSpecName: "kube-api-access-bttkd") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "kube-api-access-bttkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:16:28.231202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.231179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ad76e5f9-7f04-4a5c-8969-2959b1acbb41" (UID: "ad76e5f9-7f04-4a5c-8969-2959b1acbb41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:16:28.322206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322181    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322202    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-bound-sa-token\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322213    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bttkd\" (UniqueName: \"kubernetes.io/projected/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-kube-api-access-bttkd\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322223    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-trusted-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322232    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-image-registry-private-configuration\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322240    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-installation-pull-secrets\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322249    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-registry-certificates\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:28.322337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:28.322259    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad76e5f9-7f04-4a5c-8969-2959b1acbb41-ca-trust-extracted\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:16:29.027956 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:29.027921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz" event={"ID":"ad76e5f9-7f04-4a5c-8969-2959b1acbb41","Type":"ContainerDied","Data":"fa12a3e863684ff6029b3fa1e854d39161b9416b70b8cbca4814ed8ab5a38439"}
Sep 10 11:16:29.027956 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:29.027947    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4b57f5-g4tjz"
Sep 10 11:16:29.028430 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:29.027988    2580 scope.go:117] "RemoveContainer" containerID="74673181e11a0c2862636d4b0a5266dc3de52b2a841829049363f0b149b28715"
Sep 10 11:16:29.059272 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:29.059245    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55c4b57f5-g4tjz"]
Sep 10 11:16:29.062513 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:29.062489    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55c4b57f5-g4tjz"]
Sep 10 11:16:29.965757 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:29.965723    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qgbm6"
Sep 10 11:16:30.418733 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:30.418659    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad76e5f9-7f04-4a5c-8969-2959b1acbb41" path="/var/lib/kubelet/pods/ad76e5f9-7f04-4a5c-8969-2959b1acbb41/volumes"
Sep 10 11:16:31.040551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:31.040499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8bdc8768-pbppg" event={"ID":"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3","Type":"ContainerStarted","Data":"65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d"}
Sep 10 11:16:31.094066 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:31.094016    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8bdc8768-pbppg" podStartSLOduration=2.013832606 podStartE2EDuration="5.094001055s" totalImagesPullingTime="3.080168449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:31.09326394 +0000 UTC m=+115.187465600" watchObservedRunningTime="2026-09-10 11:16:31.094001055 +0000 UTC m=+115.188202717"
Sep 10 11:16:37.191423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.191386    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c54b59994-k7qq2"]
Sep 10 11:16:37.191899 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.191876    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad76e5f9-7f04-4a5c-8969-2959b1acbb41" containerName="registry"
Sep 10 11:16:37.191899 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.191896    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad76e5f9-7f04-4a5c-8969-2959b1acbb41" containerName="registry"
Sep 10 11:16:37.192026 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.191998    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad76e5f9-7f04-4a5c-8969-2959b1acbb41" containerName="registry"
Sep 10 11:16:37.197629 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.197600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.208166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.208147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 11:16:37.223877 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.223854    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:37.223966 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.223921    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:37.226807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.226789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c54b59994-k7qq2"]
Sep 10 11:16:37.229612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.229591    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:37.296089 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-console-config\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.296291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/dddf8525-d1ed-4820-85ab-784b34bc9001-kube-api-access-tzpcb\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.296382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-serving-cert\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.296382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-service-ca\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.296477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-oauth-config\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.296547 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-trusted-ca-bundle\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.296606 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.296545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-oauth-serving-cert\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.396866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-oauth-config\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.396983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-trusted-ca-bundle\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.396983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-oauth-serving-cert\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.396983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-console-config\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.396983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/dddf8525-d1ed-4820-85ab-784b34bc9001-kube-api-access-tzpcb\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.396983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-serving-cert\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.397242 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.396996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-service-ca\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.397714 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.397683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-oauth-serving-cert\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.397811 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.397753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-console-config\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.397850 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.397806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-service-ca\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.398217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.398188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-trusted-ca-bundle\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.399570 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.399548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-serving-cert\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.399639 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.399573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-oauth-config\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.412173 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.412147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/dddf8525-d1ed-4820-85ab-784b34bc9001-kube-api-access-tzpcb\") pod \"console-6c54b59994-k7qq2\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") " pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.506300 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.506276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:37.789473 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:37.789446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c54b59994-k7qq2"]
Sep 10 11:16:37.791086 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:37.791065    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddf8525_d1ed_4820_85ab_784b34bc9001.slice/crio-29a5111058be6553bea8b4df1152a6fe5e31345137766e91b4016b153ba7ae3f WatchSource:0}: Error finding container 29a5111058be6553bea8b4df1152a6fe5e31345137766e91b4016b153ba7ae3f: Status 404 returned error can't find the container with id 29a5111058be6553bea8b4df1152a6fe5e31345137766e91b4016b153ba7ae3f
Sep 10 11:16:38.072405 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:38.072324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c54b59994-k7qq2" event={"ID":"dddf8525-d1ed-4820-85ab-784b34bc9001","Type":"ContainerStarted","Data":"cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3"}
Sep 10 11:16:38.072405 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:38.072379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c54b59994-k7qq2" event={"ID":"dddf8525-d1ed-4820-85ab-784b34bc9001","Type":"ContainerStarted","Data":"29a5111058be6553bea8b4df1152a6fe5e31345137766e91b4016b153ba7ae3f"}
Sep 10 11:16:38.076300 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:38.076277    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:16:38.099702 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:38.099660    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c54b59994-k7qq2" podStartSLOduration=1.099645613 podStartE2EDuration="1.099645613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:38.098173808 +0000 UTC m=+122.192375468" watchObservedRunningTime="2026-09-10 11:16:38.099645613 +0000 UTC m=+122.193847330"
Sep 10 11:16:42.490394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:42.490363    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:42.490783 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:42.490416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:16:46.174190 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:46.174147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:16:46.176637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:46.176614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c5cd93-7314-4cc8-a29d-5fc3203988ee-metrics-certs\") pod \"network-metrics-daemon-x2kg2\" (UID: \"39c5cd93-7314-4cc8-a29d-5fc3203988ee\") " pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:16:46.226876 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:46.226855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kdff\""
Sep 10 11:16:46.234319 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:46.234304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2kg2"
Sep 10 11:16:46.509626 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:46.509602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x2kg2"]
Sep 10 11:16:46.511150 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:16:46.511129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c5cd93_7314_4cc8_a29d_5fc3203988ee.slice/crio-c30f9d7e0552be27b25f41d87d3d411fdeaa4fa52b4b229cee4c75b12079eacb WatchSource:0}: Error finding container c30f9d7e0552be27b25f41d87d3d411fdeaa4fa52b4b229cee4c75b12079eacb: Status 404 returned error can't find the container with id c30f9d7e0552be27b25f41d87d3d411fdeaa4fa52b4b229cee4c75b12079eacb
Sep 10 11:16:47.110644 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:47.110609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x2kg2" event={"ID":"39c5cd93-7314-4cc8-a29d-5fc3203988ee","Type":"ContainerStarted","Data":"c30f9d7e0552be27b25f41d87d3d411fdeaa4fa52b4b229cee4c75b12079eacb"}
Sep 10 11:16:47.506421 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:47.506394    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:47.506805 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:47.506478    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:47.511547 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:47.511510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:48.115770 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:48.115728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x2kg2" event={"ID":"39c5cd93-7314-4cc8-a29d-5fc3203988ee","Type":"ContainerStarted","Data":"944d1ecc288b0a76f30adb2636a659c3ba0ad3b9795b27395c646f3b1478d8e6"}
Sep 10 11:16:48.115924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:48.115796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x2kg2" event={"ID":"39c5cd93-7314-4cc8-a29d-5fc3203988ee","Type":"ContainerStarted","Data":"bd0b97f043a00df42022682a73e73cbfd0502d0f5dd847da1d05ee2990f9f50b"}
Sep 10 11:16:48.119447 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:48.119418    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:16:48.137567 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:48.137505    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x2kg2" podStartSLOduration=131.189951772 podStartE2EDuration="2m12.137492281s" totalImagesPullingTime="947.540509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:16:48.136967313 +0000 UTC m=+132.231168973" watchObservedRunningTime="2026-09-10 11:16:48.137492281 +0000 UTC m=+132.231693958"
Sep 10 11:16:48.202924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:16:48.202891    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8bdc8768-pbppg"]
Sep 10 11:17:02.495016 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:02.494980    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:17:02.498971 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:02.498945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d8bbc85cc-lvttc"
Sep 10 11:17:13.227398 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.227322    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f8bdc8768-pbppg" podUID="a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" containerName="console" containerID="cri-o://65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d" gracePeriod=15
Sep 10 11:17:13.470471 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.470448    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:17:13.583528 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dplh4\" (UniqueName: \"kubernetes.io/projected/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-kube-api-access-dplh4\") pod \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") "
Sep 10 11:17:13.583528 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-config\") pod \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") "
Sep 10 11:17:13.583728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583554    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-oauth-config\") pod \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") "
Sep 10 11:17:13.583728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583583    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-service-ca\") pod \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") "
Sep 10 11:17:13.583728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-oauth-serving-cert\") pod \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") "
Sep 10 11:17:13.583728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-serving-cert\") pod \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\" (UID: \"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3\") "
Sep 10 11:17:13.583959 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583923    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-config" (OuterVolumeSpecName: "console-config") pod "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" (UID: "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:17:13.584081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.583977    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" (UID: "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:17:13.584081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.584000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" (UID: "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:17:13.585961 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.585931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" (UID: "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:13.585961 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.585942    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-kube-api-access-dplh4" (OuterVolumeSpecName: "kube-api-access-dplh4") pod "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" (UID: "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3"). InnerVolumeSpecName "kube-api-access-dplh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:17:13.586122 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.585965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" (UID: "a891cf8a-22d4-4319-b3f5-2ac09cdd27e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:13.684475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.684440    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-serving-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:13.684475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.684472    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dplh4\" (UniqueName: \"kubernetes.io/projected/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-kube-api-access-dplh4\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:13.684475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.684481    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:13.684664 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.684489    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-console-oauth-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:13.684664 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.684497    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:13.684664 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:13.684505    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3-oauth-serving-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:14.226666 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.226634    2580 generic.go:356] "Generic (PLEG): container finished" podID="a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" containerID="65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d" exitCode=0
Sep 10 11:17:14.226864 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.226677    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8bdc8768-pbppg"
Sep 10 11:17:14.226864 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.226729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8bdc8768-pbppg" event={"ID":"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3","Type":"ContainerDied","Data":"65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d"}
Sep 10 11:17:14.226864 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.226788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8bdc8768-pbppg" event={"ID":"a891cf8a-22d4-4319-b3f5-2ac09cdd27e3","Type":"ContainerDied","Data":"555fb4867e3c6d6e9c707ea6f7dc02edef99bf69ef7ffc0858ce2feec5e47000"}
Sep 10 11:17:14.226864 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.226815    2580 scope.go:117] "RemoveContainer" containerID="65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d"
Sep 10 11:17:14.235840 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.235716    2580 scope.go:117] "RemoveContainer" containerID="65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d"
Sep 10 11:17:14.236028 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:14.235981    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d\": container with ID starting with 65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d not found: ID does not exist" containerID="65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d"
Sep 10 11:17:14.236065 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.236015    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d"} err="failed to get container status \"65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d\": rpc error: code = NotFound desc = could not find container \"65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d\": container with ID starting with 65f39f14f76c1c9595ca9822bfee1ac808741a0c88294664821bdb2d6466fd1d not found: ID does not exist"
Sep 10 11:17:14.251877 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.251851    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8bdc8768-pbppg"]
Sep 10 11:17:14.255508 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.255486    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8bdc8768-pbppg"]
Sep 10 11:17:14.418332 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:14.418290    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" path="/var/lib/kubelet/pods/a891cf8a-22d4-4319-b3f5-2ac09cdd27e3/volumes"
Sep 10 11:17:38.419505 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419472    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:17:38.419947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419761    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="alertmanager" containerID="cri-o://54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277" gracePeriod=120
Sep 10 11:17:38.419947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419836    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-web" containerID="cri-o://8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc" gracePeriod=120
Sep 10 11:17:38.419947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419863    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="config-reloader" containerID="cri-o://9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe" gracePeriod=120
Sep 10 11:17:38.419947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419885    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="prom-label-proxy" containerID="cri-o://fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283" gracePeriod=120
Sep 10 11:17:38.419947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419913    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-metric" containerID="cri-o://4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3" gracePeriod=120
Sep 10 11:17:38.420284 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:38.419881    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy" containerID="cri-o://0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98" gracePeriod=120
Sep 10 11:17:39.328599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328569    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283" exitCode=0
Sep 10 11:17:39.328599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328596    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98" exitCode=0
Sep 10 11:17:39.328599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328607    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe" exitCode=0
Sep 10 11:17:39.328599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328616    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277" exitCode=0
Sep 10 11:17:39.328866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"}
Sep 10 11:17:39.328866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"}
Sep 10 11:17:39.328866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"}
Sep 10 11:17:39.328866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.328760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"}
Sep 10 11:17:39.660072 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.660046    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:39.691941 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.691914    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-main-db\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.691952    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-tls-assets\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.691969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr42c\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-kube-api-access-mr42c\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.691993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692022    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-metrics-client-ca\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692037    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-cluster-tls-config\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692059    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-main-tls\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692097    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-out\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692115    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-volume\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692136    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-trusted-ca-bundle\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692175    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692209    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:17:39.692652 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-web-config\") pod \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\" (UID: \"a870afc8-7924-4f6a-bd7f-8d85dd151c7b\") "
Sep 10 11:17:39.692652 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692526    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-main-db\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.692652 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692593    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:17:39.692965 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.692790    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:17:39.695265 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.695236    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.695874 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.695844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.695972 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.695924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.696099 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.696066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-kube-api-access-mr42c" (OuterVolumeSpecName: "kube-api-access-mr42c") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "kube-api-access-mr42c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:17:39.696217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.696182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-out" (OuterVolumeSpecName: "config-out") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:17:39.696314 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.696292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-volume" (OuterVolumeSpecName: "config-volume") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.696511 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.696492    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:17:39.696737 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.696720    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.700448 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.700419    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.707006 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.706985    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-web-config" (OuterVolumeSpecName: "web-config") pod "a870afc8-7924-4f6a-bd7f-8d85dd151c7b" (UID: "a870afc8-7924-4f6a-bd7f-8d85dd151c7b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:17:39.793608 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793583    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-tls-assets\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793608 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793605    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr42c\" (UniqueName: \"kubernetes.io/projected/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-kube-api-access-mr42c\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793608 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793615    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793625    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-metrics-client-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793650    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-cluster-tls-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793659    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-main-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793667    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-out\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793678    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-config-volume\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793691    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793703    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793717    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:39.793842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:39.793725    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a870afc8-7924-4f6a-bd7f-8d85dd151c7b-web-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:17:40.335018 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.334980    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3" exitCode=0
Sep 10 11:17:40.335018 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.335010    2580 generic.go:356] "Generic (PLEG): container finished" podID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerID="8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc" exitCode=0
Sep 10 11:17:40.335206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.335040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"}
Sep 10 11:17:40.335206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.335068    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.335206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.335115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"}
Sep 10 11:17:40.335206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.335158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a870afc8-7924-4f6a-bd7f-8d85dd151c7b","Type":"ContainerDied","Data":"a6d617b11957f3241c7d62e57d8a212710ff9e05849ea0749a71d028385f6a29"}
Sep 10 11:17:40.335206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.335184    2580 scope.go:117] "RemoveContainer" containerID="fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"
Sep 10 11:17:40.343109 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.343082    2580 scope.go:117] "RemoveContainer" containerID="4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"
Sep 10 11:17:40.350505 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.350486    2580 scope.go:117] "RemoveContainer" containerID="0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"
Sep 10 11:17:40.357296 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.357280    2580 scope.go:117] "RemoveContainer" containerID="8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"
Sep 10 11:17:40.364053 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.364033    2580 scope.go:117] "RemoveContainer" containerID="9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"
Sep 10 11:17:40.364479 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.364452    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:17:40.371116 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.371092    2580 scope.go:117] "RemoveContainer" containerID="54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"
Sep 10 11:17:40.376492 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.376471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:17:40.378833 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.378816    2580 scope.go:117] "RemoveContainer" containerID="d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"
Sep 10 11:17:40.385699 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.385684    2580 scope.go:117] "RemoveContainer" containerID="fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"
Sep 10 11:17:40.385973 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.385954    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283\": container with ID starting with fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283 not found: ID does not exist" containerID="fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"
Sep 10 11:17:40.386041 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.385986    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"} err="failed to get container status \"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283\": rpc error: code = NotFound desc = could not find container \"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283\": container with ID starting with fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283 not found: ID does not exist"
Sep 10 11:17:40.386041 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386011    2580 scope.go:117] "RemoveContainer" containerID="4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"
Sep 10 11:17:40.386289 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.386272    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3\": container with ID starting with 4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3 not found: ID does not exist" containerID="4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"
Sep 10 11:17:40.386333 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386295    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"} err="failed to get container status \"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3\": rpc error: code = NotFound desc = could not find container \"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3\": container with ID starting with 4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3 not found: ID does not exist"
Sep 10 11:17:40.386333 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386310    2580 scope.go:117] "RemoveContainer" containerID="0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"
Sep 10 11:17:40.386516 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.386499    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98\": container with ID starting with 0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98 not found: ID does not exist" containerID="0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"
Sep 10 11:17:40.386578 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386523    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"} err="failed to get container status \"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98\": rpc error: code = NotFound desc = could not find container \"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98\": container with ID starting with 0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98 not found: ID does not exist"
Sep 10 11:17:40.386578 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386557    2580 scope.go:117] "RemoveContainer" containerID="8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"
Sep 10 11:17:40.386808 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.386793    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc\": container with ID starting with 8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc not found: ID does not exist" containerID="8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"
Sep 10 11:17:40.386860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386811    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"} err="failed to get container status \"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc\": rpc error: code = NotFound desc = could not find container \"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc\": container with ID starting with 8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc not found: ID does not exist"
Sep 10 11:17:40.386860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.386828    2580 scope.go:117] "RemoveContainer" containerID="9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"
Sep 10 11:17:40.387054 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.387039    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe\": container with ID starting with 9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe not found: ID does not exist" containerID="9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"
Sep 10 11:17:40.387097 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387057    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"} err="failed to get container status \"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe\": rpc error: code = NotFound desc = could not find container \"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe\": container with ID starting with 9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe not found: ID does not exist"
Sep 10 11:17:40.387097 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387070    2580 scope.go:117] "RemoveContainer" containerID="54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"
Sep 10 11:17:40.387284 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.387269    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277\": container with ID starting with 54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277 not found: ID does not exist" containerID="54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"
Sep 10 11:17:40.387321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387286    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"} err="failed to get container status \"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277\": rpc error: code = NotFound desc = could not find container \"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277\": container with ID starting with 54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277 not found: ID does not exist"
Sep 10 11:17:40.387321 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387296    2580 scope.go:117] "RemoveContainer" containerID="d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"
Sep 10 11:17:40.387577 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:17:40.387513    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d\": container with ID starting with d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d not found: ID does not exist" containerID="d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"
Sep 10 11:17:40.387577 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387556    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"} err="failed to get container status \"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d\": rpc error: code = NotFound desc = could not find container \"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d\": container with ID starting with d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d not found: ID does not exist"
Sep 10 11:17:40.387577 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387575    2580 scope.go:117] "RemoveContainer" containerID="fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"
Sep 10 11:17:40.387824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387808    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283"} err="failed to get container status \"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283\": rpc error: code = NotFound desc = could not find container \"fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283\": container with ID starting with fd7dfb01d75fa364cc4aabd744b778ace107f942a81ab2b8e40b337acfb5b283 not found: ID does not exist"
Sep 10 11:17:40.387869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.387826    2580 scope.go:117] "RemoveContainer" containerID="4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"
Sep 10 11:17:40.388060 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388038    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3"} err="failed to get container status \"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3\": rpc error: code = NotFound desc = could not find container \"4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3\": container with ID starting with 4164a6a1958727e9828ad7592dd8ac781c74e9f67dddf38b1498e568127ec2e3 not found: ID does not exist"
Sep 10 11:17:40.388060 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388060    2580 scope.go:117] "RemoveContainer" containerID="0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"
Sep 10 11:17:40.388309 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388291    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98"} err="failed to get container status \"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98\": rpc error: code = NotFound desc = could not find container \"0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98\": container with ID starting with 0b861df924d24b19a2dfda534faff4fc791765a7d1c829ab5055e62511f93a98 not found: ID does not exist"
Sep 10 11:17:40.388353 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388310    2580 scope.go:117] "RemoveContainer" containerID="8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"
Sep 10 11:17:40.388565 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388522    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc"} err="failed to get container status \"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc\": rpc error: code = NotFound desc = could not find container \"8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc\": container with ID starting with 8025422fb446e84c700b837a417641cbe71e54069286a9692079d18352c020cc not found: ID does not exist"
Sep 10 11:17:40.388641 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388567    2580 scope.go:117] "RemoveContainer" containerID="9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"
Sep 10 11:17:40.388824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388803    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe"} err="failed to get container status \"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe\": rpc error: code = NotFound desc = could not find container \"9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe\": container with ID starting with 9fe3e2bcb45835c178182e559e63a91720f3b7d08a5637b883d61faa90de73fe not found: ID does not exist"
Sep 10 11:17:40.388869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.388827    2580 scope.go:117] "RemoveContainer" containerID="54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"
Sep 10 11:17:40.389045 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.389025    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277"} err="failed to get container status \"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277\": rpc error: code = NotFound desc = could not find container \"54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277\": container with ID starting with 54d8a0aafd05e9a357c25eb283e11e32fdcac1aee3eb00526ea8856a0bcce277 not found: ID does not exist"
Sep 10 11:17:40.389106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.389046    2580 scope.go:117] "RemoveContainer" containerID="d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"
Sep 10 11:17:40.389281 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.389261    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d"} err="failed to get container status \"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d\": rpc error: code = NotFound desc = could not find container \"d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d\": container with ID starting with d7077673ac529b088f77b5e51997958048e8f4a3325b68f4beb5113a579a7a2d not found: ID does not exist"
Sep 10 11:17:40.417775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.417749    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" path="/var/lib/kubelet/pods/a870afc8-7924-4f6a-bd7f-8d85dd151c7b/volumes"
Sep 10 11:17:40.424120 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424095    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:17:40.424351 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424339    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="prom-label-proxy"
Sep 10 11:17:40.424389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424352    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="prom-label-proxy"
Sep 10 11:17:40.424389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424363    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="config-reloader"
Sep 10 11:17:40.424389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424368    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="config-reloader"
Sep 10 11:17:40.424389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424375    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-web"
Sep 10 11:17:40.424389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424381    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-web"
Sep 10 11:17:40.424389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424390    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424395    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424405    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" containerName="console"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424410    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" containerName="console"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424418    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="init-config-reloader"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424423    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="init-config-reloader"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424429    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-metric"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424434    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-metric"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424440    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="alertmanager"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424445    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="alertmanager"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424484    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-metric"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424492    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424498    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="kube-rbac-proxy-web"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424504    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="alertmanager"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424508    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="config-reloader"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424513    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a870afc8-7924-4f6a-bd7f-8d85dd151c7b" containerName="prom-label-proxy"
Sep 10 11:17:40.424576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.424518    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a891cf8a-22d4-4319-b3f5-2ac09cdd27e3" containerName="console"
Sep 10 11:17:40.429483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.429467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.434919 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.434902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 11:17:40.435413 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.435393    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 11:17:40.435706 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.435683    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 11:17:40.436051 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.436006    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 11:17:40.436246 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.436229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4nvmq\""
Sep 10 11:17:40.436700 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.436685    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 11:17:40.437048 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.437035    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 11:17:40.437341 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.437326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 11:17:40.441355 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.441336    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 11:17:40.447567 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.443695    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 11:17:40.485506 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.485475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:17:40.498294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da55f3e6-f1b5-4970-948b-70cd0fa44b51-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498443 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-web-config\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da55f3e6-f1b5-4970-948b-70cd0fa44b51-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498565 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ptl\" (UniqueName: \"kubernetes.io/projected/da55f3e6-f1b5-4970-948b-70cd0fa44b51-kube-api-access-52ptl\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498604 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498646 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da55f3e6-f1b5-4970-948b-70cd0fa44b51-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498680 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da55f3e6-f1b5-4970-948b-70cd0fa44b51-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498737 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-config-volume\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498857 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.498857 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.498795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da55f3e6-f1b5-4970-948b-70cd0fa44b51-config-out\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da55f3e6-f1b5-4970-948b-70cd0fa44b51-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-config-volume\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da55f3e6-f1b5-4970-948b-70cd0fa44b51-config-out\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da55f3e6-f1b5-4970-948b-70cd0fa44b51-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-web-config\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da55f3e6-f1b5-4970-948b-70cd0fa44b51-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ptl\" (UniqueName: \"kubernetes.io/projected/da55f3e6-f1b5-4970-948b-70cd0fa44b51-kube-api-access-52ptl\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.599836 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.599833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da55f3e6-f1b5-4970-948b-70cd0fa44b51-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.600739 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.600412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da55f3e6-f1b5-4970-948b-70cd0fa44b51-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.600739 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.600692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da55f3e6-f1b5-4970-948b-70cd0fa44b51-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.601219 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.601175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da55f3e6-f1b5-4970-948b-70cd0fa44b51-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.603100 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.603073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.603385 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.603360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.603575 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.603520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.603659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.603520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-config-volume\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.603951 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.603925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da55f3e6-f1b5-4970-948b-70cd0fa44b51-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.604092 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.604069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-web-config\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.604169 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.604147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.604329 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.604314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da55f3e6-f1b5-4970-948b-70cd0fa44b51-config-out\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.604663 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.604645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da55f3e6-f1b5-4970-948b-70cd0fa44b51-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.612751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.612729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ptl\" (UniqueName: \"kubernetes.io/projected/da55f3e6-f1b5-4970-948b-70cd0fa44b51-kube-api-access-52ptl\") pod \"alertmanager-main-0\" (UID: \"da55f3e6-f1b5-4970-948b-70cd0fa44b51\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:40.738280 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:40.738246    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 11:17:41.027386 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:41.027361    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 11:17:41.027755 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:17:41.027727    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda55f3e6_f1b5_4970_948b_70cd0fa44b51.slice/crio-4cf3e0898199c9bd49127699ab7c6ae1005922a8311b7b0ecbe1661ffe0f5775 WatchSource:0}: Error finding container 4cf3e0898199c9bd49127699ab7c6ae1005922a8311b7b0ecbe1661ffe0f5775: Status 404 returned error can't find the container with id 4cf3e0898199c9bd49127699ab7c6ae1005922a8311b7b0ecbe1661ffe0f5775
Sep 10 11:17:41.340800 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:41.340713    2580 generic.go:356] "Generic (PLEG): container finished" podID="da55f3e6-f1b5-4970-948b-70cd0fa44b51" containerID="f0a4b581d2e97fa7e00ffaeabe9b46b7c9a0dfb7e8a9e0f71ebb5808de316fbe" exitCode=0
Sep 10 11:17:41.340944 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:41.340808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerDied","Data":"f0a4b581d2e97fa7e00ffaeabe9b46b7c9a0dfb7e8a9e0f71ebb5808de316fbe"}
Sep 10 11:17:41.340944 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:41.340897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"4cf3e0898199c9bd49127699ab7c6ae1005922a8311b7b0ecbe1661ffe0f5775"}
Sep 10 11:17:42.349254 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.349217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"52441301926ee32e1c93b59da9c5f78397bd3426b8aee2c978d33ee14fae0d50"}
Sep 10 11:17:42.349701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.349279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"509a09ee01d03eb999eaacc8008fbc16ac50a0b9a0b4bed78238639a40b034f1"}
Sep 10 11:17:42.349701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.349304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"18b26402fedecb1db295f6802bf15fb15b6695cb13c1caf54f57863ce7a655cd"}
Sep 10 11:17:42.349701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.349327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"662e6752bd38d1149217d1fa4ed85d07a50e97fe9dabae2ac0865850d1f4063a"}
Sep 10 11:17:42.349701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.349352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"8ad1469b1a7495a6e3cf2a9e1b41464cd1e17046ad11d3d647e955edb961b8c6"}
Sep 10 11:17:42.349701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.349377    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da55f3e6-f1b5-4970-948b-70cd0fa44b51","Type":"ContainerStarted","Data":"1750cce23fe747f7f370fe1f7fcceb12ba6dfa79f57e52eb9210acca59da33b8"}
Sep 10 11:17:42.391382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:17:42.391316    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.375881698 podStartE2EDuration="2.391293609s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.411911ms" isStatefulPod=false podCreationTimestamp="2026-09-10 11:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:17:42.390206894 +0000 UTC m=+186.484408566" watchObservedRunningTime="2026-09-10 11:17:42.391293609 +0000 UTC m=+186.485495271"
Sep 10 11:18:11.657858 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.657820    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67678fd5b6-zfpnb"]
Sep 10 11:18:11.661357 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.661335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.679330 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.679309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67678fd5b6-zfpnb"]
Sep 10 11:18:11.722136 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfm54\" (UniqueName: \"kubernetes.io/projected/95b9c7e8-9f77-4485-be47-9b6adbaf9622-kube-api-access-rfm54\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.722245 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-oauth-config\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.722245 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-trusted-ca-bundle\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.722314 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-serving-cert\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.722314 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-service-ca\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.722391 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-oauth-serving-cert\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.722391 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.722374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-config\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.822982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-config\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm54\" (UniqueName: \"kubernetes.io/projected/95b9c7e8-9f77-4485-be47-9b6adbaf9622-kube-api-access-rfm54\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-oauth-config\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-trusted-ca-bundle\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-serving-cert\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-service-ca\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-oauth-serving-cert\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823759    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-config\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823935 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-service-ca\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.823996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.823934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-trusted-ca-bundle\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.824074 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.824053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-oauth-serving-cert\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.825735 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.825713    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-serving-cert\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.825779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.825721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-oauth-config\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.833171 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.833152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfm54\" (UniqueName: \"kubernetes.io/projected/95b9c7e8-9f77-4485-be47-9b6adbaf9622-kube-api-access-rfm54\") pod \"console-67678fd5b6-zfpnb\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") " pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:11.969788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:11.969766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:12.244454 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:12.244387    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67678fd5b6-zfpnb"]
Sep 10 11:18:12.247089 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:18:12.247067    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b9c7e8_9f77_4485_be47_9b6adbaf9622.slice/crio-c58f61a05a381f0750e07819d426f2017aef2d25e1c1f9056827896507a88469 WatchSource:0}: Error finding container c58f61a05a381f0750e07819d426f2017aef2d25e1c1f9056827896507a88469: Status 404 returned error can't find the container with id c58f61a05a381f0750e07819d426f2017aef2d25e1c1f9056827896507a88469
Sep 10 11:18:12.466229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:12.466187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67678fd5b6-zfpnb" event={"ID":"95b9c7e8-9f77-4485-be47-9b6adbaf9622","Type":"ContainerStarted","Data":"960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58"}
Sep 10 11:18:12.466229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:12.466242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67678fd5b6-zfpnb" event={"ID":"95b9c7e8-9f77-4485-be47-9b6adbaf9622","Type":"ContainerStarted","Data":"c58f61a05a381f0750e07819d426f2017aef2d25e1c1f9056827896507a88469"}
Sep 10 11:18:12.489653 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:12.489601    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67678fd5b6-zfpnb" podStartSLOduration=1.489585711 podStartE2EDuration="1.489585711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:18:12.48908199 +0000 UTC m=+216.583283649" watchObservedRunningTime="2026-09-10 11:18:12.489585711 +0000 UTC m=+216.583787369"
Sep 10 11:18:21.970504 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:21.970472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:21.970937 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:21.970513    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:21.974881 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:21.974862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:22.503990 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:22.503966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:18:22.567177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:22.567147    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c54b59994-k7qq2"]
Sep 10 11:18:34.535798 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.535761    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"]
Sep 10 11:18:34.539227 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.539211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.543469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.543444    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 11:18:34.544260 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.544240    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 11:18:34.546358 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.546254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g5lwg\""
Sep 10 11:18:34.553726 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.553673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"]
Sep 10 11:18:34.680478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.680445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.680592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.680483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.680592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.680577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrxt\" (UniqueName: \"kubernetes.io/projected/2e178941-d7e0-448f-a34c-216847c345c5-kube-api-access-vvrxt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.781710 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.781683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.781850 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.781762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrxt\" (UniqueName: \"kubernetes.io/projected/2e178941-d7e0-448f-a34c-216847c345c5-kube-api-access-vvrxt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.781850 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.781824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.782095 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.782071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.782161 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.782099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.795557 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.795486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrxt\" (UniqueName: \"kubernetes.io/projected/2e178941-d7e0-448f-a34c-216847c345c5-kube-api-access-vvrxt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:34.848657 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:34.848631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:35.128600 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:35.128515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"]
Sep 10 11:18:35.131394 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:18:35.131364    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e178941_d7e0_448f_a34c_216847c345c5.slice/crio-6e00c22af74f3fdf5df4252f76b17c886da18dedc45dcef06e74365fc0708087 WatchSource:0}: Error finding container 6e00c22af74f3fdf5df4252f76b17c886da18dedc45dcef06e74365fc0708087: Status 404 returned error can't find the container with id 6e00c22af74f3fdf5df4252f76b17c886da18dedc45dcef06e74365fc0708087
Sep 10 11:18:35.549739 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:35.549704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk" event={"ID":"2e178941-d7e0-448f-a34c-216847c345c5","Type":"ContainerStarted","Data":"6e00c22af74f3fdf5df4252f76b17c886da18dedc45dcef06e74365fc0708087"}
Sep 10 11:18:41.579146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:41.579114    2580 generic.go:356] "Generic (PLEG): container finished" podID="2e178941-d7e0-448f-a34c-216847c345c5" containerID="a44f392e027974277af59e65c509cbae8c8ebc1d0e3b8e48ab92ac5a47a25746" exitCode=0
Sep 10 11:18:41.579467 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:41.579152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk" event={"ID":"2e178941-d7e0-448f-a34c-216847c345c5","Type":"ContainerDied","Data":"a44f392e027974277af59e65c509cbae8c8ebc1d0e3b8e48ab92ac5a47a25746"}
Sep 10 11:18:44.591585 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:44.591549    2580 generic.go:356] "Generic (PLEG): container finished" podID="2e178941-d7e0-448f-a34c-216847c345c5" containerID="ad8675c10fe0ac70a4fa548cf2d3c302094a1e2008329e221eda6107d78ae065" exitCode=0
Sep 10 11:18:44.591964 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:44.591623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk" event={"ID":"2e178941-d7e0-448f-a34c-216847c345c5","Type":"ContainerDied","Data":"ad8675c10fe0ac70a4fa548cf2d3c302094a1e2008329e221eda6107d78ae065"}
Sep 10 11:18:47.589108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.589069    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c54b59994-k7qq2" podUID="dddf8525-d1ed-4820-85ab-784b34bc9001" containerName="console" containerID="cri-o://cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3" gracePeriod=15
Sep 10 11:18:47.842074 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.842022    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:18:47.991408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-trusted-ca-bundle\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991571 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-service-ca\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991571 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-oauth-config\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991571 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991475    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/dddf8525-d1ed-4820-85ab-784b34bc9001-kube-api-access-tzpcb\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991639    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-oauth-serving-cert\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-serving-cert\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991821 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-console-config\") pod \"dddf8525-d1ed-4820-85ab-784b34bc9001\" (UID: \"dddf8525-d1ed-4820-85ab-784b34bc9001\") "
Sep 10 11:18:47.991910 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:18:47.991910 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-service-ca" (OuterVolumeSpecName: "service-ca") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:18:47.992026 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.991959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:18:47.992077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.992021    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-trusted-ca-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:47.992077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.992039    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:47.992197 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.992178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-console-config" (OuterVolumeSpecName: "console-config") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:18:47.993840 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.993809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:18:47.994106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.994087    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:18:47.994160 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:47.994113    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dddf8525-d1ed-4820-85ab-784b34bc9001-kube-api-access-tzpcb" (OuterVolumeSpecName: "kube-api-access-tzpcb") pod "dddf8525-d1ed-4820-85ab-784b34bc9001" (UID: "dddf8525-d1ed-4820-85ab-784b34bc9001"). InnerVolumeSpecName "kube-api-access-tzpcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:18:48.093354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.093295    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-oauth-serving-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:48.093354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.093323    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-serving-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:48.093354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.093337    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dddf8525-d1ed-4820-85ab-784b34bc9001-console-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:48.093354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.093349    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dddf8525-d1ed-4820-85ab-784b34bc9001-console-oauth-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:48.093635 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.093361    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/dddf8525-d1ed-4820-85ab-784b34bc9001-kube-api-access-tzpcb\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:48.608628 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.608595    2580 generic.go:356] "Generic (PLEG): container finished" podID="dddf8525-d1ed-4820-85ab-784b34bc9001" containerID="cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3" exitCode=0
Sep 10 11:18:48.609058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.608641    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c54b59994-k7qq2"
Sep 10 11:18:48.609058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.608649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c54b59994-k7qq2" event={"ID":"dddf8525-d1ed-4820-85ab-784b34bc9001","Type":"ContainerDied","Data":"cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3"}
Sep 10 11:18:48.609058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.608687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c54b59994-k7qq2" event={"ID":"dddf8525-d1ed-4820-85ab-784b34bc9001","Type":"ContainerDied","Data":"29a5111058be6553bea8b4df1152a6fe5e31345137766e91b4016b153ba7ae3f"}
Sep 10 11:18:48.609058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.608706    2580 scope.go:117] "RemoveContainer" containerID="cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3"
Sep 10 11:18:48.617071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.617048    2580 scope.go:117] "RemoveContainer" containerID="cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3"
Sep 10 11:18:48.617320 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:18:48.617302    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3\": container with ID starting with cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3 not found: ID does not exist" containerID="cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3"
Sep 10 11:18:48.617364 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.617328    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3"} err="failed to get container status \"cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3\": rpc error: code = NotFound desc = could not find container \"cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3\": container with ID starting with cca428b5113a2e177ae50112aa4e072cd40aa2dfbc20eb16f4ba606a5f0505f3 not found: ID does not exist"
Sep 10 11:18:48.629434 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.629408    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c54b59994-k7qq2"]
Sep 10 11:18:48.630920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:48.630902    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c54b59994-k7qq2"]
Sep 10 11:18:50.418544 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:50.418504    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dddf8525-d1ed-4820-85ab-784b34bc9001" path="/var/lib/kubelet/pods/dddf8525-d1ed-4820-85ab-784b34bc9001/volumes"
Sep 10 11:18:51.624408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:51.624346    2580 generic.go:356] "Generic (PLEG): container finished" podID="2e178941-d7e0-448f-a34c-216847c345c5" containerID="6519d727f6ee7a4a7bc530739a541a4e53039e29ff49ed0d225d7b2599c6ffa5" exitCode=0
Sep 10 11:18:51.624735 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:51.624433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk" event={"ID":"2e178941-d7e0-448f-a34c-216847c345c5","Type":"ContainerDied","Data":"6519d727f6ee7a4a7bc530739a541a4e53039e29ff49ed0d225d7b2599c6ffa5"}
Sep 10 11:18:52.746859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.746838    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:52.830345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.830320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvrxt\" (UniqueName: \"kubernetes.io/projected/2e178941-d7e0-448f-a34c-216847c345c5-kube-api-access-vvrxt\") pod \"2e178941-d7e0-448f-a34c-216847c345c5\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") "
Sep 10 11:18:52.830486 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.830360    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-bundle\") pod \"2e178941-d7e0-448f-a34c-216847c345c5\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") "
Sep 10 11:18:52.830486 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.830386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-util\") pod \"2e178941-d7e0-448f-a34c-216847c345c5\" (UID: \"2e178941-d7e0-448f-a34c-216847c345c5\") "
Sep 10 11:18:52.830933 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.830907    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-bundle" (OuterVolumeSpecName: "bundle") pod "2e178941-d7e0-448f-a34c-216847c345c5" (UID: "2e178941-d7e0-448f-a34c-216847c345c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:18:52.832555 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.832502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e178941-d7e0-448f-a34c-216847c345c5-kube-api-access-vvrxt" (OuterVolumeSpecName: "kube-api-access-vvrxt") pod "2e178941-d7e0-448f-a34c-216847c345c5" (UID: "2e178941-d7e0-448f-a34c-216847c345c5"). InnerVolumeSpecName "kube-api-access-vvrxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:18:52.836463 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.836441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-util" (OuterVolumeSpecName: "util") pod "2e178941-d7e0-448f-a34c-216847c345c5" (UID: "2e178941-d7e0-448f-a34c-216847c345c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:18:52.932768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.932711    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvrxt\" (UniqueName: \"kubernetes.io/projected/2e178941-d7e0-448f-a34c-216847c345c5-kube-api-access-vvrxt\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:52.932768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.932733    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:52.932768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:52.932743    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e178941-d7e0-448f-a34c-216847c345c5-util\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:18:53.634947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:53.634918    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk"
Sep 10 11:18:53.635080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:53.634913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kjwjk" event={"ID":"2e178941-d7e0-448f-a34c-216847c345c5","Type":"ContainerDied","Data":"6e00c22af74f3fdf5df4252f76b17c886da18dedc45dcef06e74365fc0708087"}
Sep 10 11:18:53.635080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:53.635047    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e00c22af74f3fdf5df4252f76b17c886da18dedc45dcef06e74365fc0708087"
Sep 10 11:18:58.193318 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193241    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"]
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193675    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="extract"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193692    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="extract"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193711    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="util"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193720    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="util"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193733    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="pull"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193740    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="pull"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193750    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dddf8525-d1ed-4820-85ab-784b34bc9001" containerName="console"
Sep 10 11:18:58.193775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193757    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dddf8525-d1ed-4820-85ab-784b34bc9001" containerName="console"
Sep 10 11:18:58.194140 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193834    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dddf8525-d1ed-4820-85ab-784b34bc9001" containerName="console"
Sep 10 11:18:58.194140 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.193845    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e178941-d7e0-448f-a34c-216847c345c5" containerName="extract"
Sep 10 11:18:58.207582 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.207560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.211794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.211770    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 11:18:58.211794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.211776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mmm2w\""
Sep 10 11:18:58.212967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.212954    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 11:18:58.222857 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.222837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"]
Sep 10 11:18:58.371381 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.371351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad48e3a2-e1df-4861-85e3-1e62d91a703d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sb9zd\" (UID: \"ad48e3a2-e1df-4861-85e3-1e62d91a703d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.371498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.371387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868hg\" (UniqueName: \"kubernetes.io/projected/ad48e3a2-e1df-4861-85e3-1e62d91a703d-kube-api-access-868hg\") pod \"cert-manager-operator-controller-manager-55c444bf86-sb9zd\" (UID: \"ad48e3a2-e1df-4861-85e3-1e62d91a703d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.472374 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.472350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-868hg\" (UniqueName: \"kubernetes.io/projected/ad48e3a2-e1df-4861-85e3-1e62d91a703d-kube-api-access-868hg\") pod \"cert-manager-operator-controller-manager-55c444bf86-sb9zd\" (UID: \"ad48e3a2-e1df-4861-85e3-1e62d91a703d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.472483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.472417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad48e3a2-e1df-4861-85e3-1e62d91a703d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sb9zd\" (UID: \"ad48e3a2-e1df-4861-85e3-1e62d91a703d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.472788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.472773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad48e3a2-e1df-4861-85e3-1e62d91a703d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sb9zd\" (UID: \"ad48e3a2-e1df-4861-85e3-1e62d91a703d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.483265 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.483248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-868hg\" (UniqueName: \"kubernetes.io/projected/ad48e3a2-e1df-4861-85e3-1e62d91a703d-kube-api-access-868hg\") pod \"cert-manager-operator-controller-manager-55c444bf86-sb9zd\" (UID: \"ad48e3a2-e1df-4861-85e3-1e62d91a703d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.516210 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.516192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"
Sep 10 11:18:58.791939 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:58.791909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd"]
Sep 10 11:18:58.792381 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:18:58.792359    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad48e3a2_e1df_4861_85e3_1e62d91a703d.slice/crio-237ee27e37f6bc071e37997c1fba35fd48fbf08645bed433b9bca724fd2f93a1 WatchSource:0}: Error finding container 237ee27e37f6bc071e37997c1fba35fd48fbf08645bed433b9bca724fd2f93a1: Status 404 returned error can't find the container with id 237ee27e37f6bc071e37997c1fba35fd48fbf08645bed433b9bca724fd2f93a1
Sep 10 11:18:59.659724 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:18:59.659691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd" event={"ID":"ad48e3a2-e1df-4861-85e3-1e62d91a703d","Type":"ContainerStarted","Data":"237ee27e37f6bc071e37997c1fba35fd48fbf08645bed433b9bca724fd2f93a1"}
Sep 10 11:19:01.669671 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.669630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd" event={"ID":"ad48e3a2-e1df-4861-85e3-1e62d91a703d","Type":"ContainerStarted","Data":"6f2ca265c103a46ab56082353a30e9d8962a0c81d6fca8d9404cbd8b1e1c6759"}
Sep 10 11:19:01.710093 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.710045    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sb9zd" podStartSLOduration=1.5313383040000002 podStartE2EDuration="3.710029787s" totalImagesPullingTime="2.178691483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:19:01.708516503 +0000 UTC m=+265.802718161" watchObservedRunningTime="2026-09-10 11:19:01.710029787 +0000 UTC m=+265.804231446"
Sep 10 11:19:01.941247 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.941174    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tnzts"]
Sep 10 11:19:01.943230 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.943216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:01.946908 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.946885    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 11:19:01.947040 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.946936    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 11:19:01.947179 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.947165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xbthd\""
Sep 10 11:19:01.964741 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:01.964715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tnzts"]
Sep 10 11:19:02.102119 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.102090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw6l9\" (UniqueName: \"kubernetes.io/projected/a5682365-51b8-48d5-b35f-f9d5393a7e0b-kube-api-access-gw6l9\") pod \"cert-manager-webhook-6486ffd997-tnzts\" (UID: \"a5682365-51b8-48d5-b35f-f9d5393a7e0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.102249 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.102130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5682365-51b8-48d5-b35f-f9d5393a7e0b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tnzts\" (UID: \"a5682365-51b8-48d5-b35f-f9d5393a7e0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.202694 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.202634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5682365-51b8-48d5-b35f-f9d5393a7e0b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tnzts\" (UID: \"a5682365-51b8-48d5-b35f-f9d5393a7e0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.202790 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.202697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw6l9\" (UniqueName: \"kubernetes.io/projected/a5682365-51b8-48d5-b35f-f9d5393a7e0b-kube-api-access-gw6l9\") pod \"cert-manager-webhook-6486ffd997-tnzts\" (UID: \"a5682365-51b8-48d5-b35f-f9d5393a7e0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.224813 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.224787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5682365-51b8-48d5-b35f-f9d5393a7e0b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tnzts\" (UID: \"a5682365-51b8-48d5-b35f-f9d5393a7e0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.224998 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.224981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw6l9\" (UniqueName: \"kubernetes.io/projected/a5682365-51b8-48d5-b35f-f9d5393a7e0b-kube-api-access-gw6l9\") pod \"cert-manager-webhook-6486ffd997-tnzts\" (UID: \"a5682365-51b8-48d5-b35f-f9d5393a7e0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.262974 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.262955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:02.554586 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:19:02.554518    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5682365_51b8_48d5_b35f_f9d5393a7e0b.slice/crio-2eebbdc2ba01ef1f372cb4de677031268733247326c40b78036d252228901808 WatchSource:0}: Error finding container 2eebbdc2ba01ef1f372cb4de677031268733247326c40b78036d252228901808: Status 404 returned error can't find the container with id 2eebbdc2ba01ef1f372cb4de677031268733247326c40b78036d252228901808
Sep 10 11:19:02.556683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.556616    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tnzts"]
Sep 10 11:19:02.674504 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:02.674467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts" event={"ID":"a5682365-51b8-48d5-b35f-f9d5393a7e0b","Type":"ContainerStarted","Data":"2eebbdc2ba01ef1f372cb4de677031268733247326c40b78036d252228901808"}
Sep 10 11:19:05.688897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:05.688820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts" event={"ID":"a5682365-51b8-48d5-b35f-f9d5393a7e0b","Type":"ContainerStarted","Data":"ec7ba25aa56feefb5ece06bd4be38f455a8054f201f9875b15882cd0a38475d6"}
Sep 10 11:19:05.689214 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:05.688946    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:05.717411 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:05.717365    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts" podStartSLOduration=1.941559453 podStartE2EDuration="4.717350954s" totalImagesPullingTime="2.775791501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:19:05.716502929 +0000 UTC m=+269.810704588" watchObservedRunningTime="2026-09-10 11:19:05.717350954 +0000 UTC m=+269.811552613"
Sep 10 11:19:11.695782 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:11.695756    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tnzts"
Sep 10 11:19:13.076908 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.076876    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6zfh2"]
Sep 10 11:19:13.079283 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.079263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.082264 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.082246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xd2d5\""
Sep 10 11:19:13.093567 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.093521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6zfh2"]
Sep 10 11:19:13.178165 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.178139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e53f7-46cd-4381-a6f2-73a28824d529-bound-sa-token\") pod \"cert-manager-55b4d954d5-6zfh2\" (UID: \"b75e53f7-46cd-4381-a6f2-73a28824d529\") " pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.178246 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.178202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvc64\" (UniqueName: \"kubernetes.io/projected/b75e53f7-46cd-4381-a6f2-73a28824d529-kube-api-access-wvc64\") pod \"cert-manager-55b4d954d5-6zfh2\" (UID: \"b75e53f7-46cd-4381-a6f2-73a28824d529\") " pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.278762 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.278737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvc64\" (UniqueName: \"kubernetes.io/projected/b75e53f7-46cd-4381-a6f2-73a28824d529-kube-api-access-wvc64\") pod \"cert-manager-55b4d954d5-6zfh2\" (UID: \"b75e53f7-46cd-4381-a6f2-73a28824d529\") " pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.278844 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.278774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e53f7-46cd-4381-a6f2-73a28824d529-bound-sa-token\") pod \"cert-manager-55b4d954d5-6zfh2\" (UID: \"b75e53f7-46cd-4381-a6f2-73a28824d529\") " pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.288185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.288168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e53f7-46cd-4381-a6f2-73a28824d529-bound-sa-token\") pod \"cert-manager-55b4d954d5-6zfh2\" (UID: \"b75e53f7-46cd-4381-a6f2-73a28824d529\") " pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.288339 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.288324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvc64\" (UniqueName: \"kubernetes.io/projected/b75e53f7-46cd-4381-a6f2-73a28824d529-kube-api-access-wvc64\") pod \"cert-manager-55b4d954d5-6zfh2\" (UID: \"b75e53f7-46cd-4381-a6f2-73a28824d529\") " pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.388308 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.388259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6zfh2"
Sep 10 11:19:13.654952 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.654930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6zfh2"]
Sep 10 11:19:13.657190 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:19:13.657165    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb75e53f7_46cd_4381_a6f2_73a28824d529.slice/crio-8e289dd0f3c57c3165802de93e661a2ed0aac95f644002d1745fa7989827edd9 WatchSource:0}: Error finding container 8e289dd0f3c57c3165802de93e661a2ed0aac95f644002d1745fa7989827edd9: Status 404 returned error can't find the container with id 8e289dd0f3c57c3165802de93e661a2ed0aac95f644002d1745fa7989827edd9
Sep 10 11:19:13.725076 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.725037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6zfh2" event={"ID":"b75e53f7-46cd-4381-a6f2-73a28824d529","Type":"ContainerStarted","Data":"9886d9c2cbaef5064ddcd8e339ed6f9f1c9f4f1cb02720f33896b528f70e9a10"}
Sep 10 11:19:13.725182 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.725088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6zfh2" event={"ID":"b75e53f7-46cd-4381-a6f2-73a28824d529","Type":"ContainerStarted","Data":"8e289dd0f3c57c3165802de93e661a2ed0aac95f644002d1745fa7989827edd9"}
Sep 10 11:19:13.749791 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:13.749742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6zfh2" podStartSLOduration=0.749725945 podStartE2EDuration="749.725945ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:19:13.746724809 +0000 UTC m=+277.840926467" watchObservedRunningTime="2026-09-10 11:19:13.749725945 +0000 UTC m=+277.843927603"
Sep 10 11:19:36.277807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:36.277782    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 11:19:39.263917 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.263883    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"]
Sep 10 11:19:39.266248 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.266233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.269288 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.269269    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 11:19:39.270368 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.270349    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 11:19:39.270464 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.270374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g5lwg\""
Sep 10 11:19:39.278247 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.278224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"]
Sep 10 11:19:39.372071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.372047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fwpb\" (UniqueName: \"kubernetes.io/projected/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-kube-api-access-6fwpb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.372184 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.372093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.372184 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.372116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.473077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.473053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.473206 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.473082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.473263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.473208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fwpb\" (UniqueName: \"kubernetes.io/projected/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-kube-api-access-6fwpb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.473407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.473390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.476079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.473426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.484090 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.484070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fwpb\" (UniqueName: \"kubernetes.io/projected/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-kube-api-access-6fwpb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.574767 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.574708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:39.844921 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:39.844741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"]
Sep 10 11:19:39.847578 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:19:39.847519    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb2494b_8f17_4c83_b1ba_2bf10a79e952.slice/crio-9e3f38f32f598bae1b302141a963fe8daa4494d782426bcbd866d84d49c9bdc3 WatchSource:0}: Error finding container 9e3f38f32f598bae1b302141a963fe8daa4494d782426bcbd866d84d49c9bdc3: Status 404 returned error can't find the container with id 9e3f38f32f598bae1b302141a963fe8daa4494d782426bcbd866d84d49c9bdc3
Sep 10 11:19:40.838526 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:40.838440    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerID="645e6cd5ff0cace4ae00ea3e17308b328bd91a2df1bef8e86e6cb2abf7db7981" exitCode=0
Sep 10 11:19:40.838882 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:40.838516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx" event={"ID":"5fb2494b-8f17-4c83-b1ba-2bf10a79e952","Type":"ContainerDied","Data":"645e6cd5ff0cace4ae00ea3e17308b328bd91a2df1bef8e86e6cb2abf7db7981"}
Sep 10 11:19:40.838882 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:40.838594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx" event={"ID":"5fb2494b-8f17-4c83-b1ba-2bf10a79e952","Type":"ContainerStarted","Data":"9e3f38f32f598bae1b302141a963fe8daa4494d782426bcbd866d84d49c9bdc3"}
Sep 10 11:19:40.838950 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:40.838937    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:19:41.844753 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:41.844724    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerID="462a54da88a0cd9a8d2ec8736efb4691c4b5484c67b986b70899fe7d688cc2d6" exitCode=0
Sep 10 11:19:41.845091 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:41.844764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx" event={"ID":"5fb2494b-8f17-4c83-b1ba-2bf10a79e952","Type":"ContainerDied","Data":"462a54da88a0cd9a8d2ec8736efb4691c4b5484c67b986b70899fe7d688cc2d6"}
Sep 10 11:19:42.851137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:42.851104    2580 generic.go:356] "Generic (PLEG): container finished" podID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerID="acb5e431bd069a59b68bc713ed14bdb6b727a29c7c0e0a3da65499be9a98dd54" exitCode=0
Sep 10 11:19:42.851477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:42.851164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx" event={"ID":"5fb2494b-8f17-4c83-b1ba-2bf10a79e952","Type":"ContainerDied","Data":"acb5e431bd069a59b68bc713ed14bdb6b727a29c7c0e0a3da65499be9a98dd54"}
Sep 10 11:19:43.969686 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:43.969664    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:44.106523 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.106450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-util\") pod \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") "
Sep 10 11:19:44.106669 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.106527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fwpb\" (UniqueName: \"kubernetes.io/projected/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-kube-api-access-6fwpb\") pod \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") "
Sep 10 11:19:44.106669 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.106584    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-bundle\") pod \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\" (UID: \"5fb2494b-8f17-4c83-b1ba-2bf10a79e952\") "
Sep 10 11:19:44.107236 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.107210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-bundle" (OuterVolumeSpecName: "bundle") pod "5fb2494b-8f17-4c83-b1ba-2bf10a79e952" (UID: "5fb2494b-8f17-4c83-b1ba-2bf10a79e952"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:19:44.108819 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.108792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-kube-api-access-6fwpb" (OuterVolumeSpecName: "kube-api-access-6fwpb") pod "5fb2494b-8f17-4c83-b1ba-2bf10a79e952" (UID: "5fb2494b-8f17-4c83-b1ba-2bf10a79e952"). InnerVolumeSpecName "kube-api-access-6fwpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:19:44.113906 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.113882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-util" (OuterVolumeSpecName: "util") pod "5fb2494b-8f17-4c83-b1ba-2bf10a79e952" (UID: "5fb2494b-8f17-4c83-b1ba-2bf10a79e952"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:19:44.208038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.208014    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fwpb\" (UniqueName: \"kubernetes.io/projected/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-kube-api-access-6fwpb\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:19:44.208038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.208035    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:19:44.208164 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.208044    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fb2494b-8f17-4c83-b1ba-2bf10a79e952-util\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:19:44.861648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.861618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx" event={"ID":"5fb2494b-8f17-4c83-b1ba-2bf10a79e952","Type":"ContainerDied","Data":"9e3f38f32f598bae1b302141a963fe8daa4494d782426bcbd866d84d49c9bdc3"}
Sep 10 11:19:44.861648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.861643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6qczx"
Sep 10 11:19:44.861826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:44.861660    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e3f38f32f598bae1b302141a963fe8daa4494d782426bcbd866d84d49c9bdc3"
Sep 10 11:19:56.325414 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325380    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"]
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325697    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="util"
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325709    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="util"
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325718    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="pull"
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325724    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="pull"
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325731    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="extract"
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325737    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="extract"
Sep 10 11:19:56.325824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.325779    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb2494b-8f17-4c83-b1ba-2bf10a79e952" containerName="extract"
Sep 10 11:19:56.329855 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.329834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.330722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.330700    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"]
Sep 10 11:19:56.332818 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.332792    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 11:19:56.333297 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.333274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zxnsf\""
Sep 10 11:19:56.333514 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.333495    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 11:19:56.333693 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.333502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 11:19:56.333825 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.333806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.335144 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.335129    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 11:19:56.336996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.336974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 11:19:56.337088 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.336973    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g5lwg\""
Sep 10 11:19:56.337088 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.337018    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 11:19:56.364728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.364699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"]
Sep 10 11:19:56.366179 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.366159    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"]
Sep 10 11:19:56.389932 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.389905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb35081e-e25b-419a-a695-dfa9b3ceee3e-tmp\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.390038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.389950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb35081e-e25b-419a-a695-dfa9b3ceee3e-manifests\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.390038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.390018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb35081e-e25b-419a-a695-dfa9b3ceee3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.390152 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.390050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb35081e-e25b-419a-a695-dfa9b3ceee3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.390152 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.390105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgmk\" (UniqueName: \"kubernetes.io/projected/fb35081e-e25b-419a-a695-dfa9b3ceee3e-kube-api-access-6cgmk\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.490816 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.490790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb35081e-e25b-419a-a695-dfa9b3ceee3e-manifests\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.490960 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.490828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb35081e-e25b-419a-a695-dfa9b3ceee3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.490960 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.490859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb35081e-e25b-419a-a695-dfa9b3ceee3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.491175 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.491144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgmk\" (UniqueName: \"kubernetes.io/projected/fb35081e-e25b-419a-a695-dfa9b3ceee3e-kube-api-access-6cgmk\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.491250 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.491219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb35081e-e25b-419a-a695-dfa9b3ceee3e-manifests\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.491311 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.491252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.491311 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.491284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.491415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.491334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5mzm\" (UniqueName: \"kubernetes.io/projected/d3f21a29-7e35-41ef-b579-880940ca5b5b-kube-api-access-c5mzm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.491415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.491369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb35081e-e25b-419a-a695-dfa9b3ceee3e-tmp\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.493429 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.493408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb35081e-e25b-419a-a695-dfa9b3ceee3e-tmp\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.493612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.493594    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb35081e-e25b-419a-a695-dfa9b3ceee3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.494003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.493985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb35081e-e25b-419a-a695-dfa9b3ceee3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.499770 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.499743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgmk\" (UniqueName: \"kubernetes.io/projected/fb35081e-e25b-419a-a695-dfa9b3ceee3e-kube-api-access-6cgmk\") pod \"opendatahub-operator-controller-manager-d6d6998d4-s557p\" (UID: \"fb35081e-e25b-419a-a695-dfa9b3ceee3e\") " pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.592061 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.592010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.592061 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.592041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5mzm\" (UniqueName: \"kubernetes.io/projected/d3f21a29-7e35-41ef-b579-880940ca5b5b-kube-api-access-c5mzm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.592176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.592099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.592327 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.592309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.592364 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.592353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.607731 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.607703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5mzm\" (UniqueName: \"kubernetes.io/projected/d3f21a29-7e35-41ef-b579-880940ca5b5b-kube-api-access-c5mzm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.640664 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.640644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:19:56.645470 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.645452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:19:56.928159 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.928090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"]
Sep 10 11:19:56.931815 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:19:56.931779    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f21a29_7e35_41ef_b579_880940ca5b5b.slice/crio-2e89bf10d9595115ff005da626f866b9a26b064e1bb43e604dd4983cf00246e2 WatchSource:0}: Error finding container 2e89bf10d9595115ff005da626f866b9a26b064e1bb43e604dd4983cf00246e2: Status 404 returned error can't find the container with id 2e89bf10d9595115ff005da626f866b9a26b064e1bb43e604dd4983cf00246e2
Sep 10 11:19:56.938268 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:56.938243    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"]
Sep 10 11:19:56.939752 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:19:56.939730    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb35081e_e25b_419a_a695_dfa9b3ceee3e.slice/crio-cc640c8231ec3bb2faf4b6b1924ac355d81047ee6a13bd0f94c8bf69d3391cdf WatchSource:0}: Error finding container cc640c8231ec3bb2faf4b6b1924ac355d81047ee6a13bd0f94c8bf69d3391cdf: Status 404 returned error can't find the container with id cc640c8231ec3bb2faf4b6b1924ac355d81047ee6a13bd0f94c8bf69d3391cdf
Sep 10 11:19:57.929122 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:57.929083    2580 generic.go:356] "Generic (PLEG): container finished" podID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerID="bdba85986a51bf35d1f375990194c0dd9025f0e3a691e938babd53407ab48efd" exitCode=0
Sep 10 11:19:57.929570 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:57.929137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5" event={"ID":"d3f21a29-7e35-41ef-b579-880940ca5b5b","Type":"ContainerDied","Data":"bdba85986a51bf35d1f375990194c0dd9025f0e3a691e938babd53407ab48efd"}
Sep 10 11:19:57.929570 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:57.929203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5" event={"ID":"d3f21a29-7e35-41ef-b579-880940ca5b5b","Type":"ContainerStarted","Data":"2e89bf10d9595115ff005da626f866b9a26b064e1bb43e604dd4983cf00246e2"}
Sep 10 11:19:57.930951 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:57.930921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p" event={"ID":"fb35081e-e25b-419a-a695-dfa9b3ceee3e","Type":"ContainerStarted","Data":"cc640c8231ec3bb2faf4b6b1924ac355d81047ee6a13bd0f94c8bf69d3391cdf"}
Sep 10 11:19:58.938338 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:19:58.938269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5" event={"ID":"d3f21a29-7e35-41ef-b579-880940ca5b5b","Type":"ContainerStarted","Data":"d40918a32f4661aa87ce38c0b74e91a59c9190f2af0773e7cedda150826bc21b"}
Sep 10 11:20:00.949726 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:00.949691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p" event={"ID":"fb35081e-e25b-419a-a695-dfa9b3ceee3e","Type":"ContainerStarted","Data":"bda60997f97c02c90a532ff0289752e1c9e360c7d81ebc879e38d1f7a78294bc"}
Sep 10 11:20:00.951546 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:00.951511    2580 generic.go:356] "Generic (PLEG): container finished" podID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerID="d40918a32f4661aa87ce38c0b74e91a59c9190f2af0773e7cedda150826bc21b" exitCode=0
Sep 10 11:20:00.951653 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:00.951553    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5" event={"ID":"d3f21a29-7e35-41ef-b579-880940ca5b5b","Type":"ContainerDied","Data":"d40918a32f4661aa87ce38c0b74e91a59c9190f2af0773e7cedda150826bc21b"}
Sep 10 11:20:01.958226 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:01.958195    2580 generic.go:356] "Generic (PLEG): container finished" podID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerID="d7f19415cddc22af152631abfb29b18caa0300a1623cfd3af89788a6a8bdc7a8" exitCode=0
Sep 10 11:20:01.958640 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:01.958267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5" event={"ID":"d3f21a29-7e35-41ef-b579-880940ca5b5b","Type":"ContainerDied","Data":"d7f19415cddc22af152631abfb29b18caa0300a1623cfd3af89788a6a8bdc7a8"}
Sep 10 11:20:01.959766 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:01.959746    2580 generic.go:356] "Generic (PLEG): container finished" podID="fb35081e-e25b-419a-a695-dfa9b3ceee3e" containerID="bda60997f97c02c90a532ff0289752e1c9e360c7d81ebc879e38d1f7a78294bc" exitCode=0
Sep 10 11:20:01.959882 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:01.959777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p" event={"ID":"fb35081e-e25b-419a-a695-dfa9b3ceee3e","Type":"ContainerDied","Data":"bda60997f97c02c90a532ff0289752e1c9e360c7d81ebc879e38d1f7a78294bc"}
Sep 10 11:20:02.966025 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:02.965987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p" event={"ID":"fb35081e-e25b-419a-a695-dfa9b3ceee3e","Type":"ContainerStarted","Data":"5eff5f1234adb085cd911abb6320975faeb6c7ba3e801c6e4749e46d96b043f8"}
Sep 10 11:20:02.966377 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:02.966103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:20:03.002607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.002551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p" podStartSLOduration=2.174115036 podStartE2EDuration="7.002516677s" totalImagesPullingTime="3.742456856s" totalInitContainerRuntime="1.085944785s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:19:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:02.995383225 +0000 UTC m=+327.089584896" watchObservedRunningTime="2026-09-10 11:20:03.002516677 +0000 UTC m=+327.096718335"
Sep 10 11:20:03.102855 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.102833    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:20:03.250469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.250402    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5mzm\" (UniqueName: \"kubernetes.io/projected/d3f21a29-7e35-41ef-b579-880940ca5b5b-kube-api-access-c5mzm\") pod \"d3f21a29-7e35-41ef-b579-880940ca5b5b\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") "
Sep 10 11:20:03.250634 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.250491    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-util\") pod \"d3f21a29-7e35-41ef-b579-880940ca5b5b\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") "
Sep 10 11:20:03.250634 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.250561    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-bundle\") pod \"d3f21a29-7e35-41ef-b579-880940ca5b5b\" (UID: \"d3f21a29-7e35-41ef-b579-880940ca5b5b\") "
Sep 10 11:20:03.251232 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.251204    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-bundle" (OuterVolumeSpecName: "bundle") pod "d3f21a29-7e35-41ef-b579-880940ca5b5b" (UID: "d3f21a29-7e35-41ef-b579-880940ca5b5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:20:03.252691 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.252654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f21a29-7e35-41ef-b579-880940ca5b5b-kube-api-access-c5mzm" (OuterVolumeSpecName: "kube-api-access-c5mzm") pod "d3f21a29-7e35-41ef-b579-880940ca5b5b" (UID: "d3f21a29-7e35-41ef-b579-880940ca5b5b"). InnerVolumeSpecName "kube-api-access-c5mzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:20:03.255538 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.255507    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-util" (OuterVolumeSpecName: "util") pod "d3f21a29-7e35-41ef-b579-880940ca5b5b" (UID: "d3f21a29-7e35-41ef-b579-880940ca5b5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:20:03.351524 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.351497    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-util\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:03.351524 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.351519    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3f21a29-7e35-41ef-b579-880940ca5b5b-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:03.351687 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.351546    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5mzm\" (UniqueName: \"kubernetes.io/projected/d3f21a29-7e35-41ef-b579-880940ca5b5b-kube-api-access-c5mzm\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:03.972343 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.972315    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5"
Sep 10 11:20:03.972791 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.972350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nmgv5" event={"ID":"d3f21a29-7e35-41ef-b579-880940ca5b5b","Type":"ContainerDied","Data":"2e89bf10d9595115ff005da626f866b9a26b064e1bb43e604dd4983cf00246e2"}
Sep 10 11:20:03.972791 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:03.972398    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e89bf10d9595115ff005da626f866b9a26b064e1bb43e604dd4983cf00246e2"
Sep 10 11:20:13.974120 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:13.974092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d6d6998d4-s557p"
Sep 10 11:20:27.500225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500152    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"]
Sep 10 11:20:27.500618 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500603    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="extract"
Sep 10 11:20:27.500665 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500621    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="extract"
Sep 10 11:20:27.500665 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500640    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="pull"
Sep 10 11:20:27.500665 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500648    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="pull"
Sep 10 11:20:27.500751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500673    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="util"
Sep 10 11:20:27.500751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500681    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="util"
Sep 10 11:20:27.500751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.500747    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3f21a29-7e35-41ef-b579-880940ca5b5b" containerName="extract"
Sep 10 11:20:27.510416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.510394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.513413 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.513389    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 11:20:27.513596 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.513396    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 11:20:27.513596 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.513490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f2t8t\""
Sep 10 11:20:27.518106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.517916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"]
Sep 10 11:20:27.627436 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.627398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpchr\" (UniqueName: \"kubernetes.io/projected/2f33cf6c-87f9-45b0-92a3-893e855587c9-kube-api-access-kpchr\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.627625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.627462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f33cf6c-87f9-45b0-92a3-893e855587c9-tmp\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.627625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.627526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33cf6c-87f9-45b0-92a3-893e855587c9-tls-certs\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.660258 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.660228    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7xcwn"]
Sep 10 11:20:27.663284 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.663261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:27.666689 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.666665    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 11:20:27.666816 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.666743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vj5p4\""
Sep 10 11:20:27.678740 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.678716    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7xcwn"]
Sep 10 11:20:27.728636 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.728601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f33cf6c-87f9-45b0-92a3-893e855587c9-tmp\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.728808 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.728649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33cf6c-87f9-45b0-92a3-893e855587c9-tls-certs\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.728808 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.728721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpchr\" (UniqueName: \"kubernetes.io/projected/2f33cf6c-87f9-45b0-92a3-893e855587c9-kube-api-access-kpchr\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.731039 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.731008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f33cf6c-87f9-45b0-92a3-893e855587c9-tmp\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.731232 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.731216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33cf6c-87f9-45b0-92a3-893e855587c9-tls-certs\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.740388 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.740364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpchr\" (UniqueName: \"kubernetes.io/projected/2f33cf6c-87f9-45b0-92a3-893e855587c9-kube-api-access-kpchr\") pod \"kube-auth-proxy-5f4449d5c7-kgz46\" (UID: \"2f33cf6c-87f9-45b0-92a3-893e855587c9\") " pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.821441 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.821352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"
Sep 10 11:20:27.829895 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.829869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f8646c-a5b8-48c7-969e-da7db856f189-cert\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:27.830023 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.829935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr849\" (UniqueName: \"kubernetes.io/projected/61f8646c-a5b8-48c7-969e-da7db856f189-kube-api-access-wr849\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:27.931070 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.931039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f8646c-a5b8-48c7-969e-da7db856f189-cert\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:27.931233 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.931111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr849\" (UniqueName: \"kubernetes.io/projected/61f8646c-a5b8-48c7-969e-da7db856f189-kube-api-access-wr849\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:27.931233 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:20:27.931201    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 11:20:27.931318 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:20:27.931262    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f8646c-a5b8-48c7-969e-da7db856f189-cert podName:61f8646c-a5b8-48c7-969e-da7db856f189 nodeName:}" failed. No retries permitted until 2026-09-10 11:20:28.431247409 +0000 UTC m=+352.525449050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61f8646c-a5b8-48c7-969e-da7db856f189-cert") pod "odh-model-controller-7998c67dc4-7xcwn" (UID: "61f8646c-a5b8-48c7-969e-da7db856f189") : secret "odh-model-controller-webhook-cert" not found
Sep 10 11:20:27.943111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:27.943081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr849\" (UniqueName: \"kubernetes.io/projected/61f8646c-a5b8-48c7-969e-da7db856f189-kube-api-access-wr849\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:28.121436 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.121410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46"]
Sep 10 11:20:28.124322 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:20:28.124296    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f33cf6c_87f9_45b0_92a3_893e855587c9.slice/crio-fae941b890a7263f181c0208e01529dcb0ccb429c9668c35af6b77319fcdc142 WatchSource:0}: Error finding container fae941b890a7263f181c0208e01529dcb0ccb429c9668c35af6b77319fcdc142: Status 404 returned error can't find the container with id fae941b890a7263f181c0208e01529dcb0ccb429c9668c35af6b77319fcdc142
Sep 10 11:20:28.420113 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.420042    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rgcz6"]
Sep 10 11:20:28.424324 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.424302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.433213 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.433194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kq2rp\""
Sep 10 11:20:28.433469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.433454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 11:20:28.435846 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.435827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f8646c-a5b8-48c7-969e-da7db856f189-cert\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:28.438199 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.438167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f8646c-a5b8-48c7-969e-da7db856f189-cert\") pod \"odh-model-controller-7998c67dc4-7xcwn\" (UID: \"61f8646c-a5b8-48c7-969e-da7db856f189\") " pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:28.443081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.443058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rgcz6"]
Sep 10 11:20:28.536432 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.536398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdff90f5-7430-49e8-bec3-4bc9e718373b-tls-certs\") pod \"model-serving-api-54d89bd5fc-rgcz6\" (UID: \"bdff90f5-7430-49e8-bec3-4bc9e718373b\") " pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.536856 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.536554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5qb\" (UniqueName: \"kubernetes.io/projected/bdff90f5-7430-49e8-bec3-4bc9e718373b-kube-api-access-2m5qb\") pod \"model-serving-api-54d89bd5fc-rgcz6\" (UID: \"bdff90f5-7430-49e8-bec3-4bc9e718373b\") " pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.576010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.575983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:28.638722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.638080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5qb\" (UniqueName: \"kubernetes.io/projected/bdff90f5-7430-49e8-bec3-4bc9e718373b-kube-api-access-2m5qb\") pod \"model-serving-api-54d89bd5fc-rgcz6\" (UID: \"bdff90f5-7430-49e8-bec3-4bc9e718373b\") " pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.638722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.638194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdff90f5-7430-49e8-bec3-4bc9e718373b-tls-certs\") pod \"model-serving-api-54d89bd5fc-rgcz6\" (UID: \"bdff90f5-7430-49e8-bec3-4bc9e718373b\") " pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.641090 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.641046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdff90f5-7430-49e8-bec3-4bc9e718373b-tls-certs\") pod \"model-serving-api-54d89bd5fc-rgcz6\" (UID: \"bdff90f5-7430-49e8-bec3-4bc9e718373b\") " pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.652694 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.652670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5qb\" (UniqueName: \"kubernetes.io/projected/bdff90f5-7430-49e8-bec3-4bc9e718373b-kube-api-access-2m5qb\") pod \"model-serving-api-54d89bd5fc-rgcz6\" (UID: \"bdff90f5-7430-49e8-bec3-4bc9e718373b\") " pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.734223 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.734075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:28.862896 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:28.862815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7xcwn"]
Sep 10 11:20:28.865486 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:20:28.865450    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f8646c_a5b8_48c7_969e_da7db856f189.slice/crio-2ce282bc0e5fa75f4381d75e9d744ad5bd7ba3404a8b99aaa4d8708841f1dd56 WatchSource:0}: Error finding container 2ce282bc0e5fa75f4381d75e9d744ad5bd7ba3404a8b99aaa4d8708841f1dd56: Status 404 returned error can't find the container with id 2ce282bc0e5fa75f4381d75e9d744ad5bd7ba3404a8b99aaa4d8708841f1dd56
Sep 10 11:20:29.037142 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.037110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rgcz6"]
Sep 10 11:20:29.039850 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:20:29.039824    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdff90f5_7430_49e8_bec3_4bc9e718373b.slice/crio-6ab2154f90e03a3a284ef8e698daf945571380043b91673298b71fc3843e654e WatchSource:0}: Error finding container 6ab2154f90e03a3a284ef8e698daf945571380043b91673298b71fc3843e654e: Status 404 returned error can't find the container with id 6ab2154f90e03a3a284ef8e698daf945571380043b91673298b71fc3843e654e
Sep 10 11:20:29.081208 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.081159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6" event={"ID":"bdff90f5-7430-49e8-bec3-4bc9e718373b","Type":"ContainerStarted","Data":"6ab2154f90e03a3a284ef8e698daf945571380043b91673298b71fc3843e654e"}
Sep 10 11:20:29.083045 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.083019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn" event={"ID":"61f8646c-a5b8-48c7-969e-da7db856f189","Type":"ContainerStarted","Data":"2ce282bc0e5fa75f4381d75e9d744ad5bd7ba3404a8b99aaa4d8708841f1dd56"}
Sep 10 11:20:29.085111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.085060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46" event={"ID":"2f33cf6c-87f9-45b0-92a3-893e855587c9","Type":"ContainerStarted","Data":"fae941b890a7263f181c0208e01529dcb0ccb429c9668c35af6b77319fcdc142"}
Sep 10 11:20:29.271985 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.271950    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"]
Sep 10 11:20:29.276784 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.276757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.283244 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.282910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 11:20:29.283244 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.282934    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 11:20:29.283244 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.283188    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 11:20:29.283244 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.283212    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 11:20:29.283866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.283849    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h2m84\""
Sep 10 11:20:29.293646 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.293589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"]
Sep 10 11:20:29.345435 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.345435 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.345435 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.345762 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.345762 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rrk\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-kube-api-access-84rrk\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.345762 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1993e078-e0a2-43b8-a743-eb4ed774cc53-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.345762 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.345644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.446660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.446835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.446835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.446835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.446835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rrk\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-kube-api-access-84rrk\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.446835 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1993e078-e0a2-43b8-a743-eb4ed774cc53-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.447086 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.446843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.447943 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.447903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.449334 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.449309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.449611 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.449589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1993e078-e0a2-43b8-a743-eb4ed774cc53-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.449694 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.449612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.449694 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.449598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.463246 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.463222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.464942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.464919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rrk\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-kube-api-access-84rrk\") pod \"istiod-openshift-gateway-7b7995d5cd-7c6rv\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.594739 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.594332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:29.934662 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:29.934622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"]
Sep 10 11:20:31.748061 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:20:31.748032    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1993e078_e0a2_43b8_a743_eb4ed774cc53.slice/crio-bb707ec36f724b0938a8b05ab915bdc0478025a8bde6f97d23a24cfa286a5c79 WatchSource:0}: Error finding container bb707ec36f724b0938a8b05ab915bdc0478025a8bde6f97d23a24cfa286a5c79: Status 404 returned error can't find the container with id bb707ec36f724b0938a8b05ab915bdc0478025a8bde6f97d23a24cfa286a5c79
Sep 10 11:20:32.105584 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:32.105435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" event={"ID":"1993e078-e0a2-43b8-a743-eb4ed774cc53","Type":"ContainerStarted","Data":"bb707ec36f724b0938a8b05ab915bdc0478025a8bde6f97d23a24cfa286a5c79"}
Sep 10 11:20:34.120752 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.120710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn" event={"ID":"61f8646c-a5b8-48c7-969e-da7db856f189","Type":"ContainerStarted","Data":"108a9cf63634fbde6b67643ad559e8de170bbb97d59b7adc131dc1b0b3d97e83"}
Sep 10 11:20:34.121217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.120902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:34.122519 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.122490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46" event={"ID":"2f33cf6c-87f9-45b0-92a3-893e855587c9","Type":"ContainerStarted","Data":"8f76227aed3ea108fbda4ff131c4b5655004e52401b3e61d8b25e3bcb2deb495"}
Sep 10 11:20:34.124240 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.124219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6" event={"ID":"bdff90f5-7430-49e8-bec3-4bc9e718373b","Type":"ContainerStarted","Data":"8e03fd592869568c5672fc8dd59cd6712d0143af9c8d12b585de6caefef282f1"}
Sep 10 11:20:34.124367 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.124350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:34.144270 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.144226    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn" podStartSLOduration=2.410654457 podStartE2EDuration="7.144212416s" totalImagesPullingTime="4.733557959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:34.142449685 +0000 UTC m=+358.236651345" watchObservedRunningTime="2026-09-10 11:20:34.144212416 +0000 UTC m=+358.238414106"
Sep 10 11:20:34.167480 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.167445    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46" podStartSLOduration=1.709231909 podStartE2EDuration="7.167433503s" totalImagesPullingTime="5.458201594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:34.167117142 +0000 UTC m=+358.261318809" watchObservedRunningTime="2026-09-10 11:20:34.167433503 +0000 UTC m=+358.261635163"
Sep 10 11:20:34.194329 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:34.193410    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6" podStartSLOduration=1.634927378 podStartE2EDuration="6.193393072s" totalImagesPullingTime="4.558465694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:34.193239031 +0000 UTC m=+358.287440712" watchObservedRunningTime="2026-09-10 11:20:34.193393072 +0000 UTC m=+358.287594732"
Sep 10 11:20:35.021688 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:35.021647    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 11:20:35.021781 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:35.021719    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 11:20:35.132369 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:35.132306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" event={"ID":"1993e078-e0a2-43b8-a743-eb4ed774cc53","Type":"ContainerStarted","Data":"7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742"}
Sep 10 11:20:35.178717 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:35.178664    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" podStartSLOduration=2.908081408 podStartE2EDuration="6.178643536s" totalImagesPullingTime="3.270562128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:35.176825087 +0000 UTC m=+359.271026756" watchObservedRunningTime="2026-09-10 11:20:35.178643536 +0000 UTC m=+359.272845194"
Sep 10 11:20:36.138129 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:36.138056    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:36.140288 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:36.140255    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-7c6rv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 11:20:36.140440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:36.140312    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" podUID="1993e078-e0a2-43b8-a743-eb4ed774cc53" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 11:20:37.142671 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.142647    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:37.566640 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.566612    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"]
Sep 10 11:20:37.571716 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.571695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.602718 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.602685    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"]
Sep 10 11:20:37.626574 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13bb33a4-0bca-495c-b492-46362f1f4740-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.626671 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13bb33a4-0bca-495c-b492-46362f1f4740-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.626671 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.626671 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13bb33a4-0bca-495c-b492-46362f1f4740-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.626774 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.626810 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.626842 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.626827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgcp2\" (UniqueName: \"kubernetes.io/projected/13bb33a4-0bca-495c-b492-46362f1f4740-kube-api-access-pgcp2\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.727846 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgcp2\" (UniqueName: \"kubernetes.io/projected/13bb33a4-0bca-495c-b492-46362f1f4740-kube-api-access-pgcp2\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13bb33a4-0bca-495c-b492-46362f1f4740-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13bb33a4-0bca-495c-b492-46362f1f4740-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13bb33a4-0bca-495c-b492-46362f1f4740-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728003 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.727986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.728990 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.728960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13bb33a4-0bca-495c-b492-46362f1f4740-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.730662 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.730638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13bb33a4-0bca-495c-b492-46362f1f4740-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.730773 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.730672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.730773 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.730713    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.730972 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.730957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13bb33a4-0bca-495c-b492-46362f1f4740-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.746352 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.746333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13bb33a4-0bca-495c-b492-46362f1f4740-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.771853 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.771825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgcp2\" (UniqueName: \"kubernetes.io/projected/13bb33a4-0bca-495c-b492-46362f1f4740-kube-api-access-pgcp2\") pod \"istiod-openshift-gateway-5677ccb49b-888xd\" (UID: \"13bb33a4-0bca-495c-b492-46362f1f4740\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:37.881337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:37.881274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:38.222796 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:20:38.222758    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bb33a4_0bca_495c_b492_46362f1f4740.slice/crio-6e168d79955309e2a8152dbc5cb0e7935223dba50b7ebeb92333dc74fabf22b2 WatchSource:0}: Error finding container 6e168d79955309e2a8152dbc5cb0e7935223dba50b7ebeb92333dc74fabf22b2: Status 404 returned error can't find the container with id 6e168d79955309e2a8152dbc5cb0e7935223dba50b7ebeb92333dc74fabf22b2
Sep 10 11:20:38.223191 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:38.222940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"]
Sep 10 11:20:38.225039 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:38.225005    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 11:20:38.225137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:38.225065    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 11:20:39.161404 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:39.161359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd" event={"ID":"13bb33a4-0bca-495c-b492-46362f1f4740","Type":"ContainerStarted","Data":"2f295de53ddb448c559848011c10a0b6bfd7f08629d9f981345eeadf8733d3cb"}
Sep 10 11:20:39.161623 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:39.161454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd" event={"ID":"13bb33a4-0bca-495c-b492-46362f1f4740","Type":"ContainerStarted","Data":"6e168d79955309e2a8152dbc5cb0e7935223dba50b7ebeb92333dc74fabf22b2"}
Sep 10 11:20:39.162512 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:39.162363    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:39.167897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:39.167846    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-888xd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 11:20:39.168030 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:39.167897    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd" podUID="13bb33a4-0bca-495c-b492-46362f1f4740" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 11:20:39.395268 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:39.395213    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd" podStartSLOduration=2.395195839 podStartE2EDuration="2.395195839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:39.39212733 +0000 UTC m=+363.486328989" watchObservedRunningTime="2026-09-10 11:20:39.395195839 +0000 UTC m=+363.489397496"
Sep 10 11:20:40.167597 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.167571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd"
Sep 10 11:20:40.559763 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.559725    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"]
Sep 10 11:20:40.560200 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.559957    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" podUID="1993e078-e0a2-43b8-a743-eb4ed774cc53" containerName="discovery" containerID="cri-o://7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742" gracePeriod=30
Sep 10 11:20:40.802153 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.802131    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:40.854357 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-dns-cert\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.854357 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854351    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-kubeconfig\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.854497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-cacerts\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.854497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-token\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.854624 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1993e078-e0a2-43b8-a743-eb4ed774cc53-local-certs\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.854624 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84rrk\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-kube-api-access-84rrk\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.854716 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.854660    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-ca-configmap\") pod \"1993e078-e0a2-43b8-a743-eb4ed774cc53\" (UID: \"1993e078-e0a2-43b8-a743-eb4ed774cc53\") "
Sep 10 11:20:40.855359 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.855328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:20:40.856731 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.856705    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:20:40.856915 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.856892    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-kube-api-access-84rrk" (OuterVolumeSpecName: "kube-api-access-84rrk") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "kube-api-access-84rrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:20:40.857016 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.856990    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:20:40.857137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.857120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-cacerts" (OuterVolumeSpecName: "cacerts") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:20:40.857290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.857271    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-token" (OuterVolumeSpecName: "istio-token") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:20:40.857290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.857276    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1993e078-e0a2-43b8-a743-eb4ed774cc53-local-certs" (OuterVolumeSpecName: "local-certs") pod "1993e078-e0a2-43b8-a743-eb4ed774cc53" (UID: "1993e078-e0a2-43b8-a743-eb4ed774cc53"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:20:40.955729 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955704    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-ca-configmap\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:40.955820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955752    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-csr-dns-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:40.955820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955771    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-kubeconfig\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:40.955820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955781    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1993e078-e0a2-43b8-a743-eb4ed774cc53-cacerts\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:40.955820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955790    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-istio-token\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:40.955820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955805    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1993e078-e0a2-43b8-a743-eb4ed774cc53-local-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:40.955820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:40.955812    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84rrk\" (UniqueName: \"kubernetes.io/projected/1993e078-e0a2-43b8-a743-eb4ed774cc53-kube-api-access-84rrk\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:20:41.173778 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.173702    2580 generic.go:356] "Generic (PLEG): container finished" podID="1993e078-e0a2-43b8-a743-eb4ed774cc53" containerID="7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742" exitCode=0
Sep 10 11:20:41.173778 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.173742    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"
Sep 10 11:20:41.173778 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.173743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" event={"ID":"1993e078-e0a2-43b8-a743-eb4ed774cc53","Type":"ContainerDied","Data":"7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742"}
Sep 10 11:20:41.173999 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.173803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv" event={"ID":"1993e078-e0a2-43b8-a743-eb4ed774cc53","Type":"ContainerDied","Data":"bb707ec36f724b0938a8b05ab915bdc0478025a8bde6f97d23a24cfa286a5c79"}
Sep 10 11:20:41.173999 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.173829    2580 scope.go:117] "RemoveContainer" containerID="7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742"
Sep 10 11:20:41.182745 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.182730    2580 scope.go:117] "RemoveContainer" containerID="7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742"
Sep 10 11:20:41.182992 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:20:41.182974    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742\": container with ID starting with 7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742 not found: ID does not exist" containerID="7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742"
Sep 10 11:20:41.183040 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.182999    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742"} err="failed to get container status \"7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742\": rpc error: code = NotFound desc = could not find container \"7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742\": container with ID starting with 7ac954a6729c82c745977abf7d7c0cea06ae38d59da7bc60c9adbb438d09b742 not found: ID does not exist"
Sep 10 11:20:41.245980 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.245956    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"]
Sep 10 11:20:41.250013 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:41.249993    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv"]
Sep 10 11:20:42.418013 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:42.417982    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1993e078-e0a2-43b8-a743-eb4ed774cc53" path="/var/lib/kubelet/pods/1993e078-e0a2-43b8-a743-eb4ed774cc53/volumes"
Sep 10 11:20:44.058068 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.058035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"]
Sep 10 11:20:44.058585 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.058569    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1993e078-e0a2-43b8-a743-eb4ed774cc53" containerName="discovery"
Sep 10 11:20:44.058641 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.058588    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1993e078-e0a2-43b8-a743-eb4ed774cc53" containerName="discovery"
Sep 10 11:20:44.058681 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.058656    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1993e078-e0a2-43b8-a743-eb4ed774cc53" containerName="discovery"
Sep 10 11:20:44.063220 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.063204    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.071674 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.071653    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tqf4r\""
Sep 10 11:20:44.084590 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.084571    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 11:20:44.088040 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.088019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"]
Sep 10 11:20:44.186872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.186846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc4nx\" (UniqueName: \"kubernetes.io/projected/d4024fc0-3810-4b7a-bc08-f8c573cd045b-kube-api-access-pc4nx\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.186986 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.186885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4024fc0-3810-4b7a-bc08-f8c573cd045b-cert\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.287254 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.287226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc4nx\" (UniqueName: \"kubernetes.io/projected/d4024fc0-3810-4b7a-bc08-f8c573cd045b-kube-api-access-pc4nx\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.287369 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.287266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4024fc0-3810-4b7a-bc08-f8c573cd045b-cert\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.287410 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:20:44.287386    2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 11:20:44.287451 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:20:44.287443    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4024fc0-3810-4b7a-bc08-f8c573cd045b-cert podName:d4024fc0-3810-4b7a-bc08-f8c573cd045b nodeName:}" failed. No retries permitted until 2026-09-10 11:20:44.78742878 +0000 UTC m=+368.881630417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4024fc0-3810-4b7a-bc08-f8c573cd045b-cert") pod "kserve-controller-manager-d6f4b65b8-cnsr6" (UID: "d4024fc0-3810-4b7a-bc08-f8c573cd045b") : secret "kserve-webhook-server-cert" not found
Sep 10 11:20:44.345294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.345236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc4nx\" (UniqueName: \"kubernetes.io/projected/d4024fc0-3810-4b7a-bc08-f8c573cd045b-kube-api-access-pc4nx\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.792023 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.791994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4024fc0-3810-4b7a-bc08-f8c573cd045b-cert\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.794222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.794189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4024fc0-3810-4b7a-bc08-f8c573cd045b-cert\") pod \"kserve-controller-manager-d6f4b65b8-cnsr6\" (UID: \"d4024fc0-3810-4b7a-bc08-f8c573cd045b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:44.974143 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:44.974106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:45.134982 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:45.134904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7xcwn"
Sep 10 11:20:45.136756 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:45.136736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rgcz6"
Sep 10 11:20:45.279087 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:20:45.279046    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4024fc0_3810_4b7a_bc08_f8c573cd045b.slice/crio-5f8e5a3fd6ed25a27292dc439fbbd780c896d2150ae7490b84140b88d7433e04 WatchSource:0}: Error finding container 5f8e5a3fd6ed25a27292dc439fbbd780c896d2150ae7490b84140b88d7433e04: Status 404 returned error can't find the container with id 5f8e5a3fd6ed25a27292dc439fbbd780c896d2150ae7490b84140b88d7433e04
Sep 10 11:20:45.281068 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:45.281036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"]
Sep 10 11:20:46.203340 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:46.203302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6" event={"ID":"d4024fc0-3810-4b7a-bc08-f8c573cd045b","Type":"ContainerStarted","Data":"5f8e5a3fd6ed25a27292dc439fbbd780c896d2150ae7490b84140b88d7433e04"}
Sep 10 11:20:48.215358 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:48.215321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6" event={"ID":"d4024fc0-3810-4b7a-bc08-f8c573cd045b","Type":"ContainerStarted","Data":"0fb1e0fa4a54bf46139d35b73044263b8b4060265b73a3faacf3198819bc0f8f"}
Sep 10 11:20:48.215812 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:48.215434    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:20:48.245712 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:20:48.245674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6" podStartSLOduration=1.7684048049999999 podStartE2EDuration="4.245661636s" totalImagesPullingTime="2.477256831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:48.244819583 +0000 UTC m=+372.339021242" watchObservedRunningTime="2026-09-10 11:20:48.245661636 +0000 UTC m=+372.339863294"
Sep 10 11:21:19.226111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:19.226079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cnsr6"
Sep 10 11:21:34.210153 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.210117    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"]
Sep 10 11:21:34.214484 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.214459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.217648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.217623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 11:21:34.217648 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.217643    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g5lwg\""
Sep 10 11:21:34.218639 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.218619    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 11:21:34.224109 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.224076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"]
Sep 10 11:21:34.288459 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.288431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzns\" (UniqueName: \"kubernetes.io/projected/15730bed-2851-4e0c-abe4-bc34a17e6c37-kube-api-access-tvzns\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.288625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.288499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.288625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.288565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.309164 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.309135    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"]
Sep 10 11:21:34.311752 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.311736    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.324216 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.324194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"]
Sep 10 11:21:34.389701 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.389678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.389824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.389715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.389824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.389741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.389904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.389857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.389904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.389888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbfd9\" (UniqueName: \"kubernetes.io/projected/506a6449-31af-46d7-90f0-7a4f2e847d36-kube-api-access-jbfd9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.389999 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.389921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzns\" (UniqueName: \"kubernetes.io/projected/15730bed-2851-4e0c-abe4-bc34a17e6c37-kube-api-access-tvzns\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.390044 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.390025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.390148 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.390133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.399869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.399839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzns\" (UniqueName: \"kubernetes.io/projected/15730bed-2851-4e0c-abe4-bc34a17e6c37-kube-api-access-tvzns\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.491000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.490929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.491000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.490974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.491184 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.491017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfd9\" (UniqueName: \"kubernetes.io/projected/506a6449-31af-46d7-90f0-7a4f2e847d36-kube-api-access-jbfd9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.491386 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.491364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.491424 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.491394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.501366 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.501335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfd9\" (UniqueName: \"kubernetes.io/projected/506a6449-31af-46d7-90f0-7a4f2e847d36-kube-api-access-jbfd9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.527214 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.527194    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:34.621050 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.621015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:34.801051 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.801027    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"]
Sep 10 11:21:34.802702 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:21:34.802677    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15730bed_2851_4e0c_abe4_bc34a17e6c37.slice/crio-98c51ddba80d0cfc7769f9d724af3d336970814c7eef3fc08831c58ec97af33b WatchSource:0}: Error finding container 98c51ddba80d0cfc7769f9d724af3d336970814c7eef3fc08831c58ec97af33b: Status 404 returned error can't find the container with id 98c51ddba80d0cfc7769f9d724af3d336970814c7eef3fc08831c58ec97af33b
Sep 10 11:21:34.896238 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:34.896213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"]
Sep 10 11:21:34.898679 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:21:34.898655    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506a6449_31af_46d7_90f0_7a4f2e847d36.slice/crio-fc7cfa967c4b2b7b71898f54d8635a0e8432eb5aba8776a24db5110bba203f00 WatchSource:0}: Error finding container fc7cfa967c4b2b7b71898f54d8635a0e8432eb5aba8776a24db5110bba203f00: Status 404 returned error can't find the container with id fc7cfa967c4b2b7b71898f54d8635a0e8432eb5aba8776a24db5110bba203f00
Sep 10 11:21:35.261860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.261816    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66748858d6-596pm"]
Sep 10 11:21:35.264290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.264275    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.278826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.278804    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66748858d6-596pm"]
Sep 10 11:21:35.300804 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.300779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-console-config\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.300911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.300840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f500394-0740-437d-8873-12fe29ef74d1-console-serving-cert\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.300911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.300885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrx5\" (UniqueName: \"kubernetes.io/projected/7f500394-0740-437d-8873-12fe29ef74d1-kube-api-access-9vrx5\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.300993 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.300917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-trusted-ca-bundle\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.300993 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.300962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-service-ca\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.301056 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.300991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f500394-0740-437d-8873-12fe29ef74d1-console-oauth-config\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.301089 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.301074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-oauth-serving-cert\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401623 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f500394-0740-437d-8873-12fe29ef74d1-console-oauth-config\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-oauth-serving-cert\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-console-config\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f500394-0740-437d-8873-12fe29ef74d1-console-serving-cert\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrx5\" (UniqueName: \"kubernetes.io/projected/7f500394-0740-437d-8873-12fe29ef74d1-kube-api-access-9vrx5\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-trusted-ca-bundle\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.401897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.401790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-service-ca\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.402512 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.402491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-service-ca\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.402628 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.402608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-oauth-serving-cert\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.402705 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.402684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-trusted-ca-bundle\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.402742 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.402684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f500394-0740-437d-8873-12fe29ef74d1-console-config\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.404356 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.404335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f500394-0740-437d-8873-12fe29ef74d1-console-serving-cert\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.404670 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.404652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f500394-0740-437d-8873-12fe29ef74d1-console-oauth-config\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.416069 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.416044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrx5\" (UniqueName: \"kubernetes.io/projected/7f500394-0740-437d-8873-12fe29ef74d1-kube-api-access-9vrx5\") pod \"console-66748858d6-596pm\" (UID: \"7f500394-0740-437d-8873-12fe29ef74d1\") " pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.441254 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.441229    2580 generic.go:356] "Generic (PLEG): container finished" podID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerID="b889e2eb88350b0eb0b486f4debd62af48fa988cb23bd99583368629410933db" exitCode=0
Sep 10 11:21:35.441363 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.441321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k" event={"ID":"506a6449-31af-46d7-90f0-7a4f2e847d36","Type":"ContainerDied","Data":"b889e2eb88350b0eb0b486f4debd62af48fa988cb23bd99583368629410933db"}
Sep 10 11:21:35.441429 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.441367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k" event={"ID":"506a6449-31af-46d7-90f0-7a4f2e847d36","Type":"ContainerStarted","Data":"fc7cfa967c4b2b7b71898f54d8635a0e8432eb5aba8776a24db5110bba203f00"}
Sep 10 11:21:35.443004 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.442984    2580 generic.go:356] "Generic (PLEG): container finished" podID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerID="3b050978db90d52232c1d8b9c6afc002253062152778f8d6e8022475bdca10fa" exitCode=0
Sep 10 11:21:35.443100 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.443037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r" event={"ID":"15730bed-2851-4e0c-abe4-bc34a17e6c37","Type":"ContainerDied","Data":"3b050978db90d52232c1d8b9c6afc002253062152778f8d6e8022475bdca10fa"}
Sep 10 11:21:35.443100 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.443071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r" event={"ID":"15730bed-2851-4e0c-abe4-bc34a17e6c37","Type":"ContainerStarted","Data":"98c51ddba80d0cfc7769f9d724af3d336970814c7eef3fc08831c58ec97af33b"}
Sep 10 11:21:35.573489 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.573433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:35.846803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:35.846780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66748858d6-596pm"]
Sep 10 11:21:35.848638 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:21:35.848595    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f500394_0740_437d_8873_12fe29ef74d1.slice/crio-7f1d8588042a393eb97cf087f7a78edda87e386fbdb762348a7b53793793ce42 WatchSource:0}: Error finding container 7f1d8588042a393eb97cf087f7a78edda87e386fbdb762348a7b53793793ce42: Status 404 returned error can't find the container with id 7f1d8588042a393eb97cf087f7a78edda87e386fbdb762348a7b53793793ce42
Sep 10 11:21:36.450390 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:36.450357    2580 generic.go:356] "Generic (PLEG): container finished" podID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerID="74abcfb6ad87c5e2b23e64b57d107d5401000f340be75e4db665dbac16399319" exitCode=0
Sep 10 11:21:36.450791 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:36.450442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k" event={"ID":"506a6449-31af-46d7-90f0-7a4f2e847d36","Type":"ContainerDied","Data":"74abcfb6ad87c5e2b23e64b57d107d5401000f340be75e4db665dbac16399319"}
Sep 10 11:21:36.452236 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:36.452214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66748858d6-596pm" event={"ID":"7f500394-0740-437d-8873-12fe29ef74d1","Type":"ContainerStarted","Data":"5e40e37e0377dc34e5f415560e2717965c16381768a4afc734d8b76e7248a829"}
Sep 10 11:21:36.452342 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:36.452249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66748858d6-596pm" event={"ID":"7f500394-0740-437d-8873-12fe29ef74d1","Type":"ContainerStarted","Data":"7f1d8588042a393eb97cf087f7a78edda87e386fbdb762348a7b53793793ce42"}
Sep 10 11:21:36.495422 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:36.495383    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66748858d6-596pm" podStartSLOduration=1.495364702 podStartE2EDuration="1.495364702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:21:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:21:36.492755706 +0000 UTC m=+420.586957367" watchObservedRunningTime="2026-09-10 11:21:36.495364702 +0000 UTC m=+420.589566363"
Sep 10 11:21:37.459925 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:37.459894    2580 generic.go:356] "Generic (PLEG): container finished" podID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerID="93c0097766a60b8e40323aaf7e087a5bcf2769d4397b8fbca32746704e380bba" exitCode=0
Sep 10 11:21:37.460347 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:37.459986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k" event={"ID":"506a6449-31af-46d7-90f0-7a4f2e847d36","Type":"ContainerDied","Data":"93c0097766a60b8e40323aaf7e087a5bcf2769d4397b8fbca32746704e380bba"}
Sep 10 11:21:37.461859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:37.461838    2580 generic.go:356] "Generic (PLEG): container finished" podID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerID="6d2490e417947896a225bc7aac056c277d31dfc9f1e2ee8f97bcef8b08d61aa7" exitCode=0
Sep 10 11:21:37.461972 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:37.461900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r" event={"ID":"15730bed-2851-4e0c-abe4-bc34a17e6c37","Type":"ContainerDied","Data":"6d2490e417947896a225bc7aac056c277d31dfc9f1e2ee8f97bcef8b08d61aa7"}
Sep 10 11:21:38.468612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.468572    2580 generic.go:356] "Generic (PLEG): container finished" podID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerID="d036fed16a071eb9768e71dd8cad72ab2a5bd82327cd7c83f3569f379751bac9" exitCode=0
Sep 10 11:21:38.469063 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.468652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r" event={"ID":"15730bed-2851-4e0c-abe4-bc34a17e6c37","Type":"ContainerDied","Data":"d036fed16a071eb9768e71dd8cad72ab2a5bd82327cd7c83f3569f379751bac9"}
Sep 10 11:21:38.598369 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.598345    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:38.632238 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.632212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-util\") pod \"506a6449-31af-46d7-90f0-7a4f2e847d36\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") "
Sep 10 11:21:38.632361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.632251    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbfd9\" (UniqueName: \"kubernetes.io/projected/506a6449-31af-46d7-90f0-7a4f2e847d36-kube-api-access-jbfd9\") pod \"506a6449-31af-46d7-90f0-7a4f2e847d36\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") "
Sep 10 11:21:38.632361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.632353    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-bundle\") pod \"506a6449-31af-46d7-90f0-7a4f2e847d36\" (UID: \"506a6449-31af-46d7-90f0-7a4f2e847d36\") "
Sep 10 11:21:38.632798 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.632773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-bundle" (OuterVolumeSpecName: "bundle") pod "506a6449-31af-46d7-90f0-7a4f2e847d36" (UID: "506a6449-31af-46d7-90f0-7a4f2e847d36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:21:38.634755 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.634731    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506a6449-31af-46d7-90f0-7a4f2e847d36-kube-api-access-jbfd9" (OuterVolumeSpecName: "kube-api-access-jbfd9") pod "506a6449-31af-46d7-90f0-7a4f2e847d36" (UID: "506a6449-31af-46d7-90f0-7a4f2e847d36"). InnerVolumeSpecName "kube-api-access-jbfd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:21:38.637210 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.637190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-util" (OuterVolumeSpecName: "util") pod "506a6449-31af-46d7-90f0-7a4f2e847d36" (UID: "506a6449-31af-46d7-90f0-7a4f2e847d36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:21:38.733643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.733567    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:21:38.733643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.733595    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/506a6449-31af-46d7-90f0-7a4f2e847d36-util\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:21:38.733643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:38.733606    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbfd9\" (UniqueName: \"kubernetes.io/projected/506a6449-31af-46d7-90f0-7a4f2e847d36-kube-api-access-jbfd9\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:21:39.475871 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.475843    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k"
Sep 10 11:21:39.475871 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.475863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6t4z8k" event={"ID":"506a6449-31af-46d7-90f0-7a4f2e847d36","Type":"ContainerDied","Data":"fc7cfa967c4b2b7b71898f54d8635a0e8432eb5aba8776a24db5110bba203f00"}
Sep 10 11:21:39.476278 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.475906    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc7cfa967c4b2b7b71898f54d8635a0e8432eb5aba8776a24db5110bba203f00"
Sep 10 11:21:39.600630 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.600609    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:39.643110 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.643078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvzns\" (UniqueName: \"kubernetes.io/projected/15730bed-2851-4e0c-abe4-bc34a17e6c37-kube-api-access-tvzns\") pod \"15730bed-2851-4e0c-abe4-bc34a17e6c37\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") "
Sep 10 11:21:39.643248 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.643122    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-bundle\") pod \"15730bed-2851-4e0c-abe4-bc34a17e6c37\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") "
Sep 10 11:21:39.643248 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.643143    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-util\") pod \"15730bed-2851-4e0c-abe4-bc34a17e6c37\" (UID: \"15730bed-2851-4e0c-abe4-bc34a17e6c37\") "
Sep 10 11:21:39.643861 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.643757    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-bundle" (OuterVolumeSpecName: "bundle") pod "15730bed-2851-4e0c-abe4-bc34a17e6c37" (UID: "15730bed-2851-4e0c-abe4-bc34a17e6c37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:21:39.645316 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.645293    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15730bed-2851-4e0c-abe4-bc34a17e6c37-kube-api-access-tvzns" (OuterVolumeSpecName: "kube-api-access-tvzns") pod "15730bed-2851-4e0c-abe4-bc34a17e6c37" (UID: "15730bed-2851-4e0c-abe4-bc34a17e6c37"). InnerVolumeSpecName "kube-api-access-tvzns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:21:39.651258 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.651232    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-util" (OuterVolumeSpecName: "util") pod "15730bed-2851-4e0c-abe4-bc34a17e6c37" (UID: "15730bed-2851-4e0c-abe4-bc34a17e6c37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:21:39.744409 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.744337    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvzns\" (UniqueName: \"kubernetes.io/projected/15730bed-2851-4e0c-abe4-bc34a17e6c37-kube-api-access-tvzns\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:21:39.744409 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.744364    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:21:39.744409 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:39.744379    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15730bed-2851-4e0c-abe4-bc34a17e6c37-util\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:21:40.482302 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:40.482278    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r"
Sep 10 11:21:40.482302 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:40.482292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2hc7r" event={"ID":"15730bed-2851-4e0c-abe4-bc34a17e6c37","Type":"ContainerDied","Data":"98c51ddba80d0cfc7769f9d724af3d336970814c7eef3fc08831c58ec97af33b"}
Sep 10 11:21:40.482740 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:40.482333    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98c51ddba80d0cfc7769f9d724af3d336970814c7eef3fc08831c58ec97af33b"
Sep 10 11:21:45.573781 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:45.573747    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:45.574166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:45.573820    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:45.578503 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:45.578480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:46.520115 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:46.520089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66748858d6-596pm"
Sep 10 11:21:46.584798 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:46.584767    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67678fd5b6-zfpnb"]
Sep 10 11:21:51.891361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891298    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"]
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891696    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="pull"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891710    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="pull"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891722    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="extract"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891731    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="extract"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="extract"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891758    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="extract"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891771    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="pull"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891776    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="pull"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891782    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="util"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891787    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="util"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891794    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="util"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891809    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="util"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891876    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15730bed-2851-4e0c-abe4-bc34a17e6c37" containerName="extract"
Sep 10 11:21:51.891892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.891886    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="506a6449-31af-46d7-90f0-7a4f2e847d36" containerName="extract"
Sep 10 11:21:51.894353 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.894335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:51.898609 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.898591    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 11:21:51.898829 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.898814    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngvwc\""
Sep 10 11:21:51.898909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.898861    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 11:21:51.909441 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.909419    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"]
Sep 10 11:21:51.949232 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.949209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61c85874-2025-46d2-9d25-25c013aa3af1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:51.949315 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:51.949245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m782f\" (UniqueName: \"kubernetes.io/projected/61c85874-2025-46d2-9d25-25c013aa3af1-kube-api-access-m782f\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:52.049948 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.049927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61c85874-2025-46d2-9d25-25c013aa3af1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:52.050070 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.049969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m782f\" (UniqueName: \"kubernetes.io/projected/61c85874-2025-46d2-9d25-25c013aa3af1-kube-api-access-m782f\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:52.050298 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.050277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61c85874-2025-46d2-9d25-25c013aa3af1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:52.063948 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.063928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m782f\" (UniqueName: \"kubernetes.io/projected/61c85874-2025-46d2-9d25-25c013aa3af1-kube-api-access-m782f\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:52.204846 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.204821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:52.481878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.481855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"]
Sep 10 11:21:52.483439 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:21:52.483412    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c85874_2025_46d2_9d25_25c013aa3af1.slice/crio-325fd9f4d04fab668cbfe24deeac7b2a389df8f12f0839b233d727145db086f1 WatchSource:0}: Error finding container 325fd9f4d04fab668cbfe24deeac7b2a389df8f12f0839b233d727145db086f1: Status 404 returned error can't find the container with id 325fd9f4d04fab668cbfe24deeac7b2a389df8f12f0839b233d727145db086f1
Sep 10 11:21:52.548154 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:52.548121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499" event={"ID":"61c85874-2025-46d2-9d25-25c013aa3af1","Type":"ContainerStarted","Data":"325fd9f4d04fab668cbfe24deeac7b2a389df8f12f0839b233d727145db086f1"}
Sep 10 11:21:56.579209 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:56.579175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499" event={"ID":"61c85874-2025-46d2-9d25-25c013aa3af1","Type":"ContainerStarted","Data":"78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411"}
Sep 10 11:21:56.579523 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:56.579272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:21:56.603483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:21:56.603439    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499" podStartSLOduration=1.643541363 podStartE2EDuration="5.603421441s" totalImagesPullingTime="3.959880078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:21:56.600961823 +0000 UTC m=+440.695163483" watchObservedRunningTime="2026-09-10 11:21:56.603421441 +0000 UTC m=+440.697623101"
Sep 10 11:22:07.587063 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:07.587024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:22:10.084811 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.084777    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"]
Sep 10 11:22:10.085186 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.084970    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" containerName="manager" containerID="cri-o://78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411" gracePeriod=2
Sep 10 11:22:10.104425 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.104401    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"]
Sep 10 11:22:10.133722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.133692    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"]
Sep 10 11:22:10.134111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.134096    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" containerName="manager"
Sep 10 11:22:10.134186 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.134115    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" containerName="manager"
Sep 10 11:22:10.134253 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.134239    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" containerName="manager"
Sep 10 11:22:10.137217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.137199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.141171 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:22:10.141144    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:22:10.164863 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.164834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"]
Sep 10 11:22:10.180077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.180053    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"]
Sep 10 11:22:10.183323 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.183309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:10.186715 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.186697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-96jkp\""
Sep 10 11:22:10.204177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.204154    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"]
Sep 10 11:22:10.204360 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:22:10.204336    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:22:10.305162 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.305137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph8b7\" (UniqueName: \"kubernetes.io/projected/1e557612-b89b-4167-982e-5083f6d5d7b7-kube-api-access-ph8b7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7j9t7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.305306 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.305198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7bp\" (UniqueName: \"kubernetes.io/projected/8cbc1cfd-7a13-4820-8947-c0ffea5cae00-kube-api-access-tz7bp\") pod \"limitador-operator-controller-manager-74495c69f8-lfn7f\" (UID: \"8cbc1cfd-7a13-4820-8947-c0ffea5cae00\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:10.305350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.305328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e557612-b89b-4167-982e-5083f6d5d7b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7j9t7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.349379 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.349360    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:22:10.356721 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:22:10.356697    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6f499\" is forbidden: User \"system:node:ip-10-0-128-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-153.ec2.internal' and this object" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:22:10.406091 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.406062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7bp\" (UniqueName: \"kubernetes.io/projected/8cbc1cfd-7a13-4820-8947-c0ffea5cae00-kube-api-access-tz7bp\") pod \"limitador-operator-controller-manager-74495c69f8-lfn7f\" (UID: \"8cbc1cfd-7a13-4820-8947-c0ffea5cae00\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:10.406183 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.406114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e557612-b89b-4167-982e-5083f6d5d7b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7j9t7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.406183 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.406164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph8b7\" (UniqueName: \"kubernetes.io/projected/1e557612-b89b-4167-982e-5083f6d5d7b7-kube-api-access-ph8b7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7j9t7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.406514 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.406496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e557612-b89b-4167-982e-5083f6d5d7b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7j9t7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.443398 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.443377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7bp\" (UniqueName: \"kubernetes.io/projected/8cbc1cfd-7a13-4820-8947-c0ffea5cae00-kube-api-access-tz7bp\") pod \"limitador-operator-controller-manager-74495c69f8-lfn7f\" (UID: \"8cbc1cfd-7a13-4820-8947-c0ffea5cae00\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:10.443595 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.443574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph8b7\" (UniqueName: \"kubernetes.io/projected/1e557612-b89b-4167-982e-5083f6d5d7b7-kube-api-access-ph8b7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7j9t7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.471229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.471206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:10.492262 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.492237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:10.507032 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.506997    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m782f\" (UniqueName: \"kubernetes.io/projected/61c85874-2025-46d2-9d25-25c013aa3af1-kube-api-access-m782f\") pod \"61c85874-2025-46d2-9d25-25c013aa3af1\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") "
Sep 10 11:22:10.507132 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.507045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61c85874-2025-46d2-9d25-25c013aa3af1-extensions-socket-volume\") pod \"61c85874-2025-46d2-9d25-25c013aa3af1\" (UID: \"61c85874-2025-46d2-9d25-25c013aa3af1\") "
Sep 10 11:22:10.507647 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.507624    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c85874-2025-46d2-9d25-25c013aa3af1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "61c85874-2025-46d2-9d25-25c013aa3af1" (UID: "61c85874-2025-46d2-9d25-25c013aa3af1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:22:10.509358 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.509338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c85874-2025-46d2-9d25-25c013aa3af1-kube-api-access-m782f" (OuterVolumeSpecName: "kube-api-access-m782f") pod "61c85874-2025-46d2-9d25-25c013aa3af1" (UID: "61c85874-2025-46d2-9d25-25c013aa3af1"). InnerVolumeSpecName "kube-api-access-m782f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:22:10.608318 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.608258    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m782f\" (UniqueName: \"kubernetes.io/projected/61c85874-2025-46d2-9d25-25c013aa3af1-kube-api-access-m782f\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:10.608318 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.608285    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61c85874-2025-46d2-9d25-25c013aa3af1-extensions-socket-volume\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:10.658379 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.658347    2580 generic.go:356] "Generic (PLEG): container finished" podID="61c85874-2025-46d2-9d25-25c013aa3af1" containerID="78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411" exitCode=0
Sep 10 11:22:10.658488 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.658407    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6f499"
Sep 10 11:22:10.658488 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.658422    2580 scope.go:117] "RemoveContainer" containerID="78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411"
Sep 10 11:22:10.667081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.667063    2580 scope.go:117] "RemoveContainer" containerID="78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411"
Sep 10 11:22:10.667344 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:22:10.667324    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411\": container with ID starting with 78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411 not found: ID does not exist" containerID="78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411"
Sep 10 11:22:10.667395 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.667353    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411"} err="failed to get container status \"78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411\": rpc error: code = NotFound desc = could not find container \"78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411\": container with ID starting with 78355bd4ab8ac56db514824d4e15ce2e2ce5f08fa8b232cb680a4d04d8d80411 not found: ID does not exist"
Sep 10 11:22:10.773848 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.773823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"]
Sep 10 11:22:10.782258 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:22:10.782233    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e557612_b89b_4167_982e_5083f6d5d7b7.slice/crio-6a4b8eac4aad0e804e9e92a9e5529407e7dfec025342aec41d70d4b2c810d9f3 WatchSource:0}: Error finding container 6a4b8eac4aad0e804e9e92a9e5529407e7dfec025342aec41d70d4b2c810d9f3: Status 404 returned error can't find the container with id 6a4b8eac4aad0e804e9e92a9e5529407e7dfec025342aec41d70d4b2c810d9f3
Sep 10 11:22:10.793454 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:10.793434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"]
Sep 10 11:22:10.796659 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:22:10.796631    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbc1cfd_7a13_4820_8947_c0ffea5cae00.slice/crio-7a24ee398e8e09d941e31530100e66ad52f5f89463a85f38c882b865e7b0695d WatchSource:0}: Error finding container 7a24ee398e8e09d941e31530100e66ad52f5f89463a85f38c882b865e7b0695d: Status 404 returned error can't find the container with id 7a24ee398e8e09d941e31530100e66ad52f5f89463a85f38c882b865e7b0695d
Sep 10 11:22:11.611197 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:11.611153    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67678fd5b6-zfpnb" podUID="95b9c7e8-9f77-4485-be47-9b6adbaf9622" containerName="console" containerID="cri-o://960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58" gracePeriod=15
Sep 10 11:22:11.666694 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:11.666656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f" event={"ID":"8cbc1cfd-7a13-4820-8947-c0ffea5cae00","Type":"ContainerStarted","Data":"7a24ee398e8e09d941e31530100e66ad52f5f89463a85f38c882b865e7b0695d"}
Sep 10 11:22:11.668848 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:11.668751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7" event={"ID":"1e557612-b89b-4167-982e-5083f6d5d7b7","Type":"ContainerStarted","Data":"46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1"}
Sep 10 11:22:11.668848 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:11.668803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7" event={"ID":"1e557612-b89b-4167-982e-5083f6d5d7b7","Type":"ContainerStarted","Data":"6a4b8eac4aad0e804e9e92a9e5529407e7dfec025342aec41d70d4b2c810d9f3"}
Sep 10 11:22:11.669031 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:11.668918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:11.714923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:11.714862    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7" podStartSLOduration=1.714841968 podStartE2EDuration="1.714841968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:22:11.711901362 +0000 UTC m=+455.806103022" watchObservedRunningTime="2026-09-10 11:22:11.714841968 +0000 UTC m=+455.809043628"
Sep 10 11:22:12.076752 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.076730    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:22:12.223375 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223351    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-oauth-config\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-config\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-oauth-serving-cert\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-serving-cert\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-service-ca\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223637 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfm54\" (UniqueName: \"kubernetes.io/projected/95b9c7e8-9f77-4485-be47-9b6adbaf9622-kube-api-access-rfm54\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223791 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-trusted-ca-bundle\") pod \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\" (UID: \"95b9c7e8-9f77-4485-be47-9b6adbaf9622\") "
Sep 10 11:22:12.223914 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223891    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:22:12.223998 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.223935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-config" (OuterVolumeSpecName: "console-config") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:22:12.224053 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.224037    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.224093 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.224066    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-oauth-serving-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.224093 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.224032    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-service-ca" (OuterVolumeSpecName: "service-ca") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:22:12.224195 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.224180    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:22:12.225739 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.225721    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:22:12.226234 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.226218    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:22:12.226283 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.226259    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b9c7e8-9f77-4485-be47-9b6adbaf9622-kube-api-access-rfm54" (OuterVolumeSpecName: "kube-api-access-rfm54") pod "95b9c7e8-9f77-4485-be47-9b6adbaf9622" (UID: "95b9c7e8-9f77-4485-be47-9b6adbaf9622"). InnerVolumeSpecName "kube-api-access-rfm54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:22:12.324920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.324856    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-serving-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.324920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.324880    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.324920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.324889    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfm54\" (UniqueName: \"kubernetes.io/projected/95b9c7e8-9f77-4485-be47-9b6adbaf9622-kube-api-access-rfm54\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.324920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.324898    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95b9c7e8-9f77-4485-be47-9b6adbaf9622-trusted-ca-bundle\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.324920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.324906    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95b9c7e8-9f77-4485-be47-9b6adbaf9622-console-oauth-config\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:12.419319 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.419290    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61c85874-2025-46d2-9d25-25c013aa3af1" path="/var/lib/kubelet/pods/61c85874-2025-46d2-9d25-25c013aa3af1/volumes"
Sep 10 11:22:12.676741 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.676670    2580 generic.go:356] "Generic (PLEG): container finished" podID="95b9c7e8-9f77-4485-be47-9b6adbaf9622" containerID="960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58" exitCode=0
Sep 10 11:22:12.676741 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.676720    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67678fd5b6-zfpnb"
Sep 10 11:22:12.677185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.676760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67678fd5b6-zfpnb" event={"ID":"95b9c7e8-9f77-4485-be47-9b6adbaf9622","Type":"ContainerDied","Data":"960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58"}
Sep 10 11:22:12.677185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.676807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67678fd5b6-zfpnb" event={"ID":"95b9c7e8-9f77-4485-be47-9b6adbaf9622","Type":"ContainerDied","Data":"c58f61a05a381f0750e07819d426f2017aef2d25e1c1f9056827896507a88469"}
Sep 10 11:22:12.677185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.676832    2580 scope.go:117] "RemoveContainer" containerID="960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58"
Sep 10 11:22:12.678844 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.678745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f" event={"ID":"8cbc1cfd-7a13-4820-8947-c0ffea5cae00","Type":"ContainerStarted","Data":"8e15a1ba11316c99ec98d9d102a97e894b2a1ee53072a434c2bd1aa0f19faf7c"}
Sep 10 11:22:12.678844 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.678788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:12.687607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.687507    2580 scope.go:117] "RemoveContainer" containerID="960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58"
Sep 10 11:22:12.688111 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:22:12.688091    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58\": container with ID starting with 960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58 not found: ID does not exist" containerID="960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58"
Sep 10 11:22:12.688190 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.688117    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58"} err="failed to get container status \"960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58\": rpc error: code = NotFound desc = could not find container \"960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58\": container with ID starting with 960b3e0947d3e8fa5c9ac29d893862c134910204039b8215039d1b7a0b532c58 not found: ID does not exist"
Sep 10 11:22:12.714922 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.714876    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f" podStartSLOduration=1.39583085 podStartE2EDuration="2.714858988s" totalImagesPullingTime="1.319028138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:22:12.711875447 +0000 UTC m=+456.806077108" watchObservedRunningTime="2026-09-10 11:22:12.714858988 +0000 UTC m=+456.809060648"
Sep 10 11:22:12.732858 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.732831    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67678fd5b6-zfpnb"]
Sep 10 11:22:12.740796 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:12.740773    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67678fd5b6-zfpnb"]
Sep 10 11:22:14.419357 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:14.419323    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b9c7e8-9f77-4485-be47-9b6adbaf9622" path="/var/lib/kubelet/pods/95b9c7e8-9f77-4485-be47-9b6adbaf9622/volumes"
Sep 10 11:22:22.681467 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:22.681435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:23.686763 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:23.686738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lfn7f"
Sep 10 11:22:27.833426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:27.833391    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"]
Sep 10 11:22:27.833905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:27.833664    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7" podUID="1e557612-b89b-4167-982e-5083f6d5d7b7" containerName="manager" containerID="cri-o://46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1" gracePeriod=10
Sep 10 11:22:28.578146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.578123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:28.745888 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.745860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph8b7\" (UniqueName: \"kubernetes.io/projected/1e557612-b89b-4167-982e-5083f6d5d7b7-kube-api-access-ph8b7\") pod \"1e557612-b89b-4167-982e-5083f6d5d7b7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") "
Sep 10 11:22:28.746048 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.745922    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e557612-b89b-4167-982e-5083f6d5d7b7-extensions-socket-volume\") pod \"1e557612-b89b-4167-982e-5083f6d5d7b7\" (UID: \"1e557612-b89b-4167-982e-5083f6d5d7b7\") "
Sep 10 11:22:28.746257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.746234    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e557612-b89b-4167-982e-5083f6d5d7b7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1e557612-b89b-4167-982e-5083f6d5d7b7" (UID: "1e557612-b89b-4167-982e-5083f6d5d7b7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:22:28.747983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.747962    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e557612-b89b-4167-982e-5083f6d5d7b7-kube-api-access-ph8b7" (OuterVolumeSpecName: "kube-api-access-ph8b7") pod "1e557612-b89b-4167-982e-5083f6d5d7b7" (UID: "1e557612-b89b-4167-982e-5083f6d5d7b7"). InnerVolumeSpecName "kube-api-access-ph8b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:22:28.770642 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.770620    2580 generic.go:356] "Generic (PLEG): container finished" podID="1e557612-b89b-4167-982e-5083f6d5d7b7" containerID="46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1" exitCode=0
Sep 10 11:22:28.770746 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.770665    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"
Sep 10 11:22:28.770746 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.770710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7" event={"ID":"1e557612-b89b-4167-982e-5083f6d5d7b7","Type":"ContainerDied","Data":"46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1"}
Sep 10 11:22:28.770822 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.770759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7" event={"ID":"1e557612-b89b-4167-982e-5083f6d5d7b7","Type":"ContainerDied","Data":"6a4b8eac4aad0e804e9e92a9e5529407e7dfec025342aec41d70d4b2c810d9f3"}
Sep 10 11:22:28.770822 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.770783    2580 scope.go:117] "RemoveContainer" containerID="46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1"
Sep 10 11:22:28.779803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.779789    2580 scope.go:117] "RemoveContainer" containerID="46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1"
Sep 10 11:22:28.780069 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:22:28.780051    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1\": container with ID starting with 46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1 not found: ID does not exist" containerID="46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1"
Sep 10 11:22:28.780113 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.780078    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1"} err="failed to get container status \"46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1\": rpc error: code = NotFound desc = could not find container \"46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1\": container with ID starting with 46d675d352acacbff5bf7fb9e43a5ad306a33c4903be0ef7416e970f398730d1 not found: ID does not exist"
Sep 10 11:22:28.793716 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.793687    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"]
Sep 10 11:22:28.797464 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.797443    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7j9t7"]
Sep 10 11:22:28.846810 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.846789    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e557612-b89b-4167-982e-5083f6d5d7b7-extensions-socket-volume\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:28.846810 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:28.846807    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph8b7\" (UniqueName: \"kubernetes.io/projected/1e557612-b89b-4167-982e-5083f6d5d7b7-kube-api-access-ph8b7\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:22:30.418754 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:30.418719    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e557612-b89b-4167-982e-5083f6d5d7b7" path="/var/lib/kubelet/pods/1e557612-b89b-4167-982e-5083f6d5d7b7/volumes"
Sep 10 11:22:46.709225 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709192    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:22:46.709607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709545    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b9c7e8-9f77-4485-be47-9b6adbaf9622" containerName="console"
Sep 10 11:22:46.709607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709557    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b9c7e8-9f77-4485-be47-9b6adbaf9622" containerName="console"
Sep 10 11:22:46.709607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709583    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e557612-b89b-4167-982e-5083f6d5d7b7" containerName="manager"
Sep 10 11:22:46.709607 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709589    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e557612-b89b-4167-982e-5083f6d5d7b7" containerName="manager"
Sep 10 11:22:46.709779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709648    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e557612-b89b-4167-982e-5083f6d5d7b7" containerName="manager"
Sep 10 11:22:46.709779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.709655    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b9c7e8-9f77-4485-be47-9b6adbaf9622" containerName="console"
Sep 10 11:22:46.712712 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.712697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:46.716100 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.716081    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 11:22:46.716212 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.716155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-75ljd\""
Sep 10 11:22:46.727071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.727049    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:22:46.785968 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.785932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvjj4\" (UniqueName: \"kubernetes.io/projected/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-kube-api-access-fvjj4\") pod \"limitador-limitador-8588749977-gq9m2\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") " pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:46.786110 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.786052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-config-file\") pod \"limitador-limitador-8588749977-gq9m2\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") " pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:46.800166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.800141    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:22:46.886503 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.886472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvjj4\" (UniqueName: \"kubernetes.io/projected/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-kube-api-access-fvjj4\") pod \"limitador-limitador-8588749977-gq9m2\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") " pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:46.886749 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.886571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-config-file\") pod \"limitador-limitador-8588749977-gq9m2\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") " pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:46.887220 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.887197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-config-file\") pod \"limitador-limitador-8588749977-gq9m2\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") " pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:46.897149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:46.897127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvjj4\" (UniqueName: \"kubernetes.io/projected/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-kube-api-access-fvjj4\") pod \"limitador-limitador-8588749977-gq9m2\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") " pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:47.023013 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.022951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:47.300828 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.300802    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:22:47.303111 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:22:47.303081    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd89c3a5_7d9f_4c79_a5e3_de0652be21db.slice/crio-fd736135ccf4e99cb94bdf35d75d49e554509895ed92ee7e36c31af2a790ecd1 WatchSource:0}: Error finding container fd736135ccf4e99cb94bdf35d75d49e554509895ed92ee7e36c31af2a790ecd1: Status 404 returned error can't find the container with id fd736135ccf4e99cb94bdf35d75d49e554509895ed92ee7e36c31af2a790ecd1
Sep 10 11:22:47.715443 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.715418    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-bkhzh"]
Sep 10 11:22:47.718399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.718379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:22:47.720995 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.720980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sqzbm\""
Sep 10 11:22:47.726755 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.726733    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bkhzh"]
Sep 10 11:22:47.794862 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.794838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vm9t\" (UniqueName: \"kubernetes.io/projected/ea9b6d44-afe2-4f32-a7a9-cd5055839918-kube-api-access-6vm9t\") pod \"authorino-59c974bd48-bkhzh\" (UID: \"ea9b6d44-afe2-4f32-a7a9-cd5055839918\") " pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:22:47.868055 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.868031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2" event={"ID":"bd89c3a5-7d9f-4c79-a5e3-de0652be21db","Type":"ContainerStarted","Data":"fd736135ccf4e99cb94bdf35d75d49e554509895ed92ee7e36c31af2a790ecd1"}
Sep 10 11:22:47.895606 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.895582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vm9t\" (UniqueName: \"kubernetes.io/projected/ea9b6d44-afe2-4f32-a7a9-cd5055839918-kube-api-access-6vm9t\") pod \"authorino-59c974bd48-bkhzh\" (UID: \"ea9b6d44-afe2-4f32-a7a9-cd5055839918\") " pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:22:47.905239 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:47.905211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vm9t\" (UniqueName: \"kubernetes.io/projected/ea9b6d44-afe2-4f32-a7a9-cd5055839918-kube-api-access-6vm9t\") pod \"authorino-59c974bd48-bkhzh\" (UID: \"ea9b6d44-afe2-4f32-a7a9-cd5055839918\") " pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:22:48.029073 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:48.029005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:22:48.299519 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:48.299489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bkhzh"]
Sep 10 11:22:48.465933 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:22:48.465903    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea9b6d44_afe2_4f32_a7a9_cd5055839918.slice/crio-8f9d60aa3f49bfac1e26b0442bd534bc33dbaf1179dd9fd14c6a710672f46abb WatchSource:0}: Error finding container 8f9d60aa3f49bfac1e26b0442bd534bc33dbaf1179dd9fd14c6a710672f46abb: Status 404 returned error can't find the container with id 8f9d60aa3f49bfac1e26b0442bd534bc33dbaf1179dd9fd14c6a710672f46abb
Sep 10 11:22:48.874611 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:48.874496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2" event={"ID":"bd89c3a5-7d9f-4c79-a5e3-de0652be21db","Type":"ContainerStarted","Data":"81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2"}
Sep 10 11:22:48.875007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:48.874646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:22:48.875761 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:48.875741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bkhzh" event={"ID":"ea9b6d44-afe2-4f32-a7a9-cd5055839918","Type":"ContainerStarted","Data":"8f9d60aa3f49bfac1e26b0442bd534bc33dbaf1179dd9fd14c6a710672f46abb"}
Sep 10 11:22:48.892917 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:48.892872    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2" podStartSLOduration=1.699713574 podStartE2EDuration="2.892854795s" totalImagesPullingTime="1.193141221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:22:48.892663186 +0000 UTC m=+492.986864846" watchObservedRunningTime="2026-09-10 11:22:48.892854795 +0000 UTC m=+492.987056456"
Sep 10 11:22:50.891979 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:50.891900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bkhzh" event={"ID":"ea9b6d44-afe2-4f32-a7a9-cd5055839918","Type":"ContainerStarted","Data":"7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937"}
Sep 10 11:22:50.908183 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:50.908134    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-bkhzh" podStartSLOduration=1.9044753349999999 podStartE2EDuration="3.908120271s" totalImagesPullingTime="2.003644936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:22:50.907647173 +0000 UTC m=+495.001848836" watchObservedRunningTime="2026-09-10 11:22:50.908120271 +0000 UTC m=+495.002321932"
Sep 10 11:22:59.886176 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:22:59.886145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:23:00.995440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:00.995407    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:23:00.995867 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:00.995582    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2" podUID="bd89c3a5-7d9f-4c79-a5e3-de0652be21db" containerName="limitador" containerID="cri-o://81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2" gracePeriod=30
Sep 10 11:23:01.545599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.545577    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:23:01.614730 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.614653    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvjj4\" (UniqueName: \"kubernetes.io/projected/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-kube-api-access-fvjj4\") pod \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") "
Sep 10 11:23:01.614907 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.614794    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-config-file\") pod \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\" (UID: \"bd89c3a5-7d9f-4c79-a5e3-de0652be21db\") "
Sep 10 11:23:01.615138 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.615118    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-config-file" (OuterVolumeSpecName: "config-file") pod "bd89c3a5-7d9f-4c79-a5e3-de0652be21db" (UID: "bd89c3a5-7d9f-4c79-a5e3-de0652be21db"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:23:01.616983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.616955    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-kube-api-access-fvjj4" (OuterVolumeSpecName: "kube-api-access-fvjj4") pod "bd89c3a5-7d9f-4c79-a5e3-de0652be21db" (UID: "bd89c3a5-7d9f-4c79-a5e3-de0652be21db"). InnerVolumeSpecName "kube-api-access-fvjj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:23:01.716413 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.716379    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvjj4\" (UniqueName: \"kubernetes.io/projected/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-kube-api-access-fvjj4\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:23:01.716413 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.716406    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd89c3a5-7d9f-4c79-a5e3-de0652be21db-config-file\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:23:01.948870 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.948789    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd89c3a5-7d9f-4c79-a5e3-de0652be21db" containerID="81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2" exitCode=0
Sep 10 11:23:01.948870 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.948833    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2"
Sep 10 11:23:01.948870 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.948833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2" event={"ID":"bd89c3a5-7d9f-4c79-a5e3-de0652be21db","Type":"ContainerDied","Data":"81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2"}
Sep 10 11:23:01.949079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.948888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gq9m2" event={"ID":"bd89c3a5-7d9f-4c79-a5e3-de0652be21db","Type":"ContainerDied","Data":"fd736135ccf4e99cb94bdf35d75d49e554509895ed92ee7e36c31af2a790ecd1"}
Sep 10 11:23:01.949079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.948920    2580 scope.go:117] "RemoveContainer" containerID="81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2"
Sep 10 11:23:01.959980 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.959963    2580 scope.go:117] "RemoveContainer" containerID="81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2"
Sep 10 11:23:01.960266 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:23:01.960243    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2\": container with ID starting with 81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2 not found: ID does not exist" containerID="81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2"
Sep 10 11:23:01.960310 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.960275    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2"} err="failed to get container status \"81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2\": rpc error: code = NotFound desc = could not find container \"81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2\": container with ID starting with 81831a21eac89428fab4ae0a42baa8330540149881830a7c5784c9522fce2ea2 not found: ID does not exist"
Sep 10 11:23:01.975563 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.972987    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:23:01.980008 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:01.979981    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gq9m2"]
Sep 10 11:23:02.418412 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:02.418375    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd89c3a5-7d9f-4c79-a5e3-de0652be21db" path="/var/lib/kubelet/pods/bd89c3a5-7d9f-4c79-a5e3-de0652be21db/volumes"
Sep 10 11:23:03.244396 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.244354    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"]
Sep 10 11:23:03.244992 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.244955    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd89c3a5-7d9f-4c79-a5e3-de0652be21db" containerName="limitador"
Sep 10 11:23:03.244992 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.244980    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd89c3a5-7d9f-4c79-a5e3-de0652be21db" containerName="limitador"
Sep 10 11:23:03.245156 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.245065    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd89c3a5-7d9f-4c79-a5e3-de0652be21db" containerName="limitador"
Sep 10 11:23:03.247788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.247770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.250631 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.250609    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 11:23:03.250754 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.250688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-phv7v\""
Sep 10 11:23:03.250843 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.250711    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 11:23:03.251737 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.251717    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 11:23:03.257856 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.257833    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"]
Sep 10 11:23:03.330266 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.330240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b10eed45-d7f4-4728-ad78-def1666c0ebf-data\") pod \"postgres-69fb4594cf-jbpqq\" (UID: \"b10eed45-d7f4-4728-ad78-def1666c0ebf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.330363 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.330287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4txm\" (UniqueName: \"kubernetes.io/projected/b10eed45-d7f4-4728-ad78-def1666c0ebf-kube-api-access-d4txm\") pod \"postgres-69fb4594cf-jbpqq\" (UID: \"b10eed45-d7f4-4728-ad78-def1666c0ebf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.431145 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.431115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4txm\" (UniqueName: \"kubernetes.io/projected/b10eed45-d7f4-4728-ad78-def1666c0ebf-kube-api-access-d4txm\") pod \"postgres-69fb4594cf-jbpqq\" (UID: \"b10eed45-d7f4-4728-ad78-def1666c0ebf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.431481 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.431208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b10eed45-d7f4-4728-ad78-def1666c0ebf-data\") pod \"postgres-69fb4594cf-jbpqq\" (UID: \"b10eed45-d7f4-4728-ad78-def1666c0ebf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.431564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.431522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b10eed45-d7f4-4728-ad78-def1666c0ebf-data\") pod \"postgres-69fb4594cf-jbpqq\" (UID: \"b10eed45-d7f4-4728-ad78-def1666c0ebf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.439601 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.439582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4txm\" (UniqueName: \"kubernetes.io/projected/b10eed45-d7f4-4728-ad78-def1666c0ebf-kube-api-access-d4txm\") pod \"postgres-69fb4594cf-jbpqq\" (UID: \"b10eed45-d7f4-4728-ad78-def1666c0ebf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.559513 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.559462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:03.827430 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.827405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"]
Sep 10 11:23:03.829126 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:23:03.829092    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10eed45_d7f4_4728_ad78_def1666c0ebf.slice/crio-da86203e37eac50c87be765b6ede68b1a02aa7d0474539db37a8dc6d020fd583 WatchSource:0}: Error finding container da86203e37eac50c87be765b6ede68b1a02aa7d0474539db37a8dc6d020fd583: Status 404 returned error can't find the container with id da86203e37eac50c87be765b6ede68b1a02aa7d0474539db37a8dc6d020fd583
Sep 10 11:23:03.961514 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:03.961479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq" event={"ID":"b10eed45-d7f4-4728-ad78-def1666c0ebf","Type":"ContainerStarted","Data":"da86203e37eac50c87be765b6ede68b1a02aa7d0474539db37a8dc6d020fd583"}
Sep 10 11:23:08.995621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:08.995582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq" event={"ID":"b10eed45-d7f4-4728-ad78-def1666c0ebf","Type":"ContainerStarted","Data":"38c7b66e4eaf70ce8f25c0abb59a0c70918b5114e55852d19d1b1afa8492d0e5"}
Sep 10 11:23:08.995964 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:08.995714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:09.013262 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:09.013219    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq" podStartSLOduration=1.031988833 podStartE2EDuration="6.013202754s" totalImagesPullingTime="4.981213921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:23:09.012051209 +0000 UTC m=+513.106252872" watchObservedRunningTime="2026-09-10 11:23:09.013202754 +0000 UTC m=+513.107404413"
Sep 10 11:23:15.031611 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:15.031581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jbpqq"
Sep 10 11:23:17.705802 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:17.705771    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bkhzh"]
Sep 10 11:23:17.706195 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:17.705936    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-bkhzh" podUID="ea9b6d44-afe2-4f32-a7a9-cd5055839918" containerName="authorino" containerID="cri-o://7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937" gracePeriod=30
Sep 10 11:23:17.957910 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:17.957853    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:23:18.042840 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.042809    2580 generic.go:356] "Generic (PLEG): container finished" podID="ea9b6d44-afe2-4f32-a7a9-cd5055839918" containerID="7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937" exitCode=0
Sep 10 11:23:18.042953 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.042846    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bkhzh"
Sep 10 11:23:18.042953 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.042870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bkhzh" event={"ID":"ea9b6d44-afe2-4f32-a7a9-cd5055839918","Type":"ContainerDied","Data":"7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937"}
Sep 10 11:23:18.042953 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.042901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bkhzh" event={"ID":"ea9b6d44-afe2-4f32-a7a9-cd5055839918","Type":"ContainerDied","Data":"8f9d60aa3f49bfac1e26b0442bd534bc33dbaf1179dd9fd14c6a710672f46abb"}
Sep 10 11:23:18.042953 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.042919    2580 scope.go:117] "RemoveContainer" containerID="7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937"
Sep 10 11:23:18.051144 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.051117    2580 scope.go:117] "RemoveContainer" containerID="7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937"
Sep 10 11:23:18.051415 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:23:18.051391    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937\": container with ID starting with 7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937 not found: ID does not exist" containerID="7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937"
Sep 10 11:23:18.051475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.051427    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937"} err="failed to get container status \"7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937\": rpc error: code = NotFound desc = could not find container \"7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937\": container with ID starting with 7d98d54bd678ab17ab192f5bae1fd3f1c176052f8198c2e2eb3e5ab3eb493937 not found: ID does not exist"
Sep 10 11:23:18.059420 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.059401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vm9t\" (UniqueName: \"kubernetes.io/projected/ea9b6d44-afe2-4f32-a7a9-cd5055839918-kube-api-access-6vm9t\") pod \"ea9b6d44-afe2-4f32-a7a9-cd5055839918\" (UID: \"ea9b6d44-afe2-4f32-a7a9-cd5055839918\") "
Sep 10 11:23:18.061455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.061433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9b6d44-afe2-4f32-a7a9-cd5055839918-kube-api-access-6vm9t" (OuterVolumeSpecName: "kube-api-access-6vm9t") pod "ea9b6d44-afe2-4f32-a7a9-cd5055839918" (UID: "ea9b6d44-afe2-4f32-a7a9-cd5055839918"). InnerVolumeSpecName "kube-api-access-6vm9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:23:18.160306 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.160278    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vm9t\" (UniqueName: \"kubernetes.io/projected/ea9b6d44-afe2-4f32-a7a9-cd5055839918-kube-api-access-6vm9t\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:23:18.364667 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.364638    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bkhzh"]
Sep 10 11:23:18.368395 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.368374    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bkhzh"]
Sep 10 11:23:18.418597 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:18.418573    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea9b6d44-afe2-4f32-a7a9-cd5055839918" path="/var/lib/kubelet/pods/ea9b6d44-afe2-4f32-a7a9-cd5055839918/volumes"
Sep 10 11:23:23.305930 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.305900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8bcfb4695-tfw7j"]
Sep 10 11:23:23.306301 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.306255    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9b6d44-afe2-4f32-a7a9-cd5055839918" containerName="authorino"
Sep 10 11:23:23.306301 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.306266    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9b6d44-afe2-4f32-a7a9-cd5055839918" containerName="authorino"
Sep 10 11:23:23.306387 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.306336    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9b6d44-afe2-4f32-a7a9-cd5055839918" containerName="authorino"
Sep 10 11:23:23.325016 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.324990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8bcfb4695-tfw7j"]
Sep 10 11:23:23.325189 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.325108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.328142 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.328119    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 11:23:23.328274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.328163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qnv8w\""
Sep 10 11:23:23.328274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.328202    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 11:23:23.328274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.328131    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 11:23:23.496161 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.496130    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-686898fd-97wdq"]
Sep 10 11:23:23.498824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.498807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.506713 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.506680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.506826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.506729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-webhook-cert\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.506900 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.506843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rw4\" (UniqueName: \"kubernetes.io/projected/eff2637a-70f9-4892-84b1-e499b11b68a0-kube-api-access-62rw4\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.511073 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.511049    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686898fd-97wdq"]
Sep 10 11:23:23.608033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.607968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-webhook-cert\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.608154 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.608060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.608154 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:23:23.608079    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 11:23:23.608154 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.608122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-webhook-cert\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.608154 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:23:23.608131    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs podName:eff2637a-70f9-4892-84b1-e499b11b68a0 nodeName:}" failed. No retries permitted until 2026-09-10 11:23:24.108113501 +0000 UTC m=+528.202315141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs") pod "maas-controller-8bcfb4695-tfw7j" (UID: "eff2637a-70f9-4892-84b1-e499b11b68a0") : secret "maas-controller-metrics-tls" not found
Sep 10 11:23:23.608378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.608176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-metrics-certs\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.608378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.608220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g4pt\" (UniqueName: \"kubernetes.io/projected/983d0d34-e61d-435f-978a-b2e4c1d56d92-kube-api-access-6g4pt\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.608378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.608279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62rw4\" (UniqueName: \"kubernetes.io/projected/eff2637a-70f9-4892-84b1-e499b11b68a0-kube-api-access-62rw4\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.610706 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.610687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-webhook-cert\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.618110 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.618078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rw4\" (UniqueName: \"kubernetes.io/projected/eff2637a-70f9-4892-84b1-e499b11b68a0-kube-api-access-62rw4\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:23.709278 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.709251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-webhook-cert\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.709378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.709300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-metrics-certs\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.709432 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.709411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g4pt\" (UniqueName: \"kubernetes.io/projected/983d0d34-e61d-435f-978a-b2e4c1d56d92-kube-api-access-6g4pt\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.711584 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.711561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-metrics-certs\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.711692 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.711677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-webhook-cert\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.718634 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.718611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g4pt\" (UniqueName: \"kubernetes.io/projected/983d0d34-e61d-435f-978a-b2e4c1d56d92-kube-api-access-6g4pt\") pod \"maas-controller-686898fd-97wdq\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") " pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:23.810655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:23.810630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:24.084691 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:24.084665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686898fd-97wdq"]
Sep 10 11:23:24.085581 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:23:24.085555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983d0d34_e61d_435f_978a_b2e4c1d56d92.slice/crio-0ae7b10255f490eb71f5611d86fbfb2be9a87f4a5c163bf2f31127f107bdc2b8 WatchSource:0}: Error finding container 0ae7b10255f490eb71f5611d86fbfb2be9a87f4a5c163bf2f31127f107bdc2b8: Status 404 returned error can't find the container with id 0ae7b10255f490eb71f5611d86fbfb2be9a87f4a5c163bf2f31127f107bdc2b8
Sep 10 11:23:24.112781 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:24.112723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:24.115129 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:24.115109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs\") pod \"maas-controller-8bcfb4695-tfw7j\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") " pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:24.239428 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:24.239386    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:24.509709 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:24.509686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8bcfb4695-tfw7j"]
Sep 10 11:23:24.511219 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:23:24.511189    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff2637a_70f9_4892_84b1_e499b11b68a0.slice/crio-a4c0f4cba602b07f781830586fa62f40e4a7c4c59bb553f6498a53172a35538a WatchSource:0}: Error finding container a4c0f4cba602b07f781830586fa62f40e4a7c4c59bb553f6498a53172a35538a: Status 404 returned error can't find the container with id a4c0f4cba602b07f781830586fa62f40e4a7c4c59bb553f6498a53172a35538a
Sep 10 11:23:25.089584 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:25.089485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8bcfb4695-tfw7j" event={"ID":"eff2637a-70f9-4892-84b1-e499b11b68a0","Type":"ContainerStarted","Data":"a4c0f4cba602b07f781830586fa62f40e4a7c4c59bb553f6498a53172a35538a"}
Sep 10 11:23:25.092253 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:25.092175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-97wdq" event={"ID":"983d0d34-e61d-435f-978a-b2e4c1d56d92","Type":"ContainerStarted","Data":"0ae7b10255f490eb71f5611d86fbfb2be9a87f4a5c163bf2f31127f107bdc2b8"}
Sep 10 11:23:27.105112 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:27.105017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8bcfb4695-tfw7j" event={"ID":"eff2637a-70f9-4892-84b1-e499b11b68a0","Type":"ContainerStarted","Data":"55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4"}
Sep 10 11:23:27.105112 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:27.105087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:27.106655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:27.106629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-97wdq" event={"ID":"983d0d34-e61d-435f-978a-b2e4c1d56d92","Type":"ContainerStarted","Data":"27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45"}
Sep 10 11:23:27.106759 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:27.106746    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:27.136846 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:27.136783    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8bcfb4695-tfw7j" podStartSLOduration=1.843225281 podStartE2EDuration="4.136768898s" totalImagesPullingTime="2.293543617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:23:27.135199692 +0000 UTC m=+531.229401345" watchObservedRunningTime="2026-09-10 11:23:27.136768898 +0000 UTC m=+531.230970580"
Sep 10 11:23:27.167290 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:27.167248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-686898fd-97wdq" podStartSLOduration=1.457311275 podStartE2EDuration="4.167231304s" totalImagesPullingTime="2.709920029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:23:27.167067935 +0000 UTC m=+531.261269591" watchObservedRunningTime="2026-09-10 11:23:27.167231304 +0000 UTC m=+531.261432965"
Sep 10 11:23:38.114140 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.114103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:23:38.114624 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.114196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:38.184578 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.184526    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8bcfb4695-tfw7j"]
Sep 10 11:23:38.184819 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.184790    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8bcfb4695-tfw7j" podUID="eff2637a-70f9-4892-84b1-e499b11b68a0" containerName="manager" containerID="cri-o://55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4" gracePeriod=30
Sep 10 11:23:38.444422 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.444399    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:38.526261 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.526234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62rw4\" (UniqueName: \"kubernetes.io/projected/eff2637a-70f9-4892-84b1-e499b11b68a0-kube-api-access-62rw4\") pod \"eff2637a-70f9-4892-84b1-e499b11b68a0\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") "
Sep 10 11:23:38.526412 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.526313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs\") pod \"eff2637a-70f9-4892-84b1-e499b11b68a0\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") "
Sep 10 11:23:38.526412 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.526334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-webhook-cert\") pod \"eff2637a-70f9-4892-84b1-e499b11b68a0\" (UID: \"eff2637a-70f9-4892-84b1-e499b11b68a0\") "
Sep 10 11:23:38.528544 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.528496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eff2637a-70f9-4892-84b1-e499b11b68a0" (UID: "eff2637a-70f9-4892-84b1-e499b11b68a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:23:38.528652 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.528564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eff2637a-70f9-4892-84b1-e499b11b68a0" (UID: "eff2637a-70f9-4892-84b1-e499b11b68a0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:23:38.528652 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.528575    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff2637a-70f9-4892-84b1-e499b11b68a0-kube-api-access-62rw4" (OuterVolumeSpecName: "kube-api-access-62rw4") pod "eff2637a-70f9-4892-84b1-e499b11b68a0" (UID: "eff2637a-70f9-4892-84b1-e499b11b68a0"). InnerVolumeSpecName "kube-api-access-62rw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:23:38.627346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.627322    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:23:38.627346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.627342    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff2637a-70f9-4892-84b1-e499b11b68a0-webhook-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:23:38.627346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:38.627352    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62rw4\" (UniqueName: \"kubernetes.io/projected/eff2637a-70f9-4892-84b1-e499b11b68a0-kube-api-access-62rw4\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:23:39.173378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.173339    2580 generic.go:356] "Generic (PLEG): container finished" podID="eff2637a-70f9-4892-84b1-e499b11b68a0" containerID="55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4" exitCode=0
Sep 10 11:23:39.173904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.173399    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8bcfb4695-tfw7j"
Sep 10 11:23:39.173904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.173424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8bcfb4695-tfw7j" event={"ID":"eff2637a-70f9-4892-84b1-e499b11b68a0","Type":"ContainerDied","Data":"55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4"}
Sep 10 11:23:39.173904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.173486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8bcfb4695-tfw7j" event={"ID":"eff2637a-70f9-4892-84b1-e499b11b68a0","Type":"ContainerDied","Data":"a4c0f4cba602b07f781830586fa62f40e4a7c4c59bb553f6498a53172a35538a"}
Sep 10 11:23:39.173904 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.173512    2580 scope.go:117] "RemoveContainer" containerID="55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4"
Sep 10 11:23:39.183099 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.183081    2580 scope.go:117] "RemoveContainer" containerID="55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4"
Sep 10 11:23:39.183380 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:23:39.183362    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4\": container with ID starting with 55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4 not found: ID does not exist" containerID="55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4"
Sep 10 11:23:39.183450 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.183387    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4"} err="failed to get container status \"55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4\": rpc error: code = NotFound desc = could not find container \"55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4\": container with ID starting with 55b3bb80646989918eb47339634e1f40b6705534699721099a2c6f8202d98cc4 not found: ID does not exist"
Sep 10 11:23:39.195658 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.195635    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8bcfb4695-tfw7j"]
Sep 10 11:23:39.201999 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:39.201976    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8bcfb4695-tfw7j"]
Sep 10 11:23:40.420139 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:23:40.420099    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff2637a-70f9-4892-84b1-e499b11b68a0" path="/var/lib/kubelet/pods/eff2637a-70f9-4892-84b1-e499b11b68a0/volumes"
Sep 10 11:24:00.294136 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.294105    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"]
Sep 10 11:24:00.294495 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.294479    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff2637a-70f9-4892-84b1-e499b11b68a0" containerName="manager"
Sep 10 11:24:00.294495 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.294490    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff2637a-70f9-4892-84b1-e499b11b68a0" containerName="manager"
Sep 10 11:24:00.294623 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.294600    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff2637a-70f9-4892-84b1-e499b11b68a0" containerName="manager"
Sep 10 11:24:00.297743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.297726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.300291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.300273    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 11:24:00.300415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.300273    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 11:24:00.300415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.300311    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gkwvn\""
Sep 10 11:24:00.311146 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.311123    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"]
Sep 10 11:24:00.392869 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.392842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-openshift-service-ca\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.393010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.392898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ckpx\" (UniqueName: \"kubernetes.io/projected/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-kube-api-access-4ckpx\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.393010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.392938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-metrics-certs\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.393108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.393088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-maas-api-tls\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.494281 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.494255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-openshift-service-ca\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.494426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.494295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ckpx\" (UniqueName: \"kubernetes.io/projected/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-kube-api-access-4ckpx\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.494426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.494327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-metrics-certs\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.494601 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.494432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-maas-api-tls\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.495044 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.495018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-openshift-service-ca\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.497035 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.497015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-maas-api-tls\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.497178 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.497159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-metrics-certs\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.504103 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.504078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ckpx\" (UniqueName: \"kubernetes.io/projected/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-kube-api-access-4ckpx\") pod \"maas-api-5c55758554-jtxwp\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") " pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.609291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.609223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:00.859705 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.859620    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"]
Sep 10 11:24:00.863350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.863327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:00.866453 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.866421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 11:24:00.866606 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.866506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9mn6n\""
Sep 10 11:24:00.876445 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.876415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"]
Sep 10 11:24:00.882404 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.882379    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"]
Sep 10 11:24:00.886302 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.886283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:00.892830 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.892769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"]
Sep 10 11:24:00.894682 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:24:00.894611    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfa90d7_b1ca_47a1_936a_045f9b4f5297.slice/crio-18921664793e67b24c00e345976dd75a32eeb14adcc65c3f33557a0df944af38 WatchSource:0}: Error finding container 18921664793e67b24c00e345976dd75a32eeb14adcc65c3f33557a0df944af38: Status 404 returned error can't find the container with id 18921664793e67b24c00e345976dd75a32eeb14adcc65c3f33557a0df944af38
Sep 10 11:24:00.898284 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.898256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc4fcfd-fca7-4bf9-8234-a7d0291e9529-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2cjnv\" (UID: \"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:00.898376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.898303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8n8\" (UniqueName: \"kubernetes.io/projected/6cc4fcfd-fca7-4bf9-8234-a7d0291e9529-kube-api-access-pr8n8\") pod \"payload-pre-processing-59fbc47bf8-2cjnv\" (UID: \"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:00.899826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.899806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"]
Sep 10 11:24:00.999852 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.999816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc4fcfd-fca7-4bf9-8234-a7d0291e9529-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2cjnv\" (UID: \"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:01.000002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.999874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8n8\" (UniqueName: \"kubernetes.io/projected/6cc4fcfd-fca7-4bf9-8234-a7d0291e9529-kube-api-access-pr8n8\") pod \"payload-pre-processing-59fbc47bf8-2cjnv\" (UID: \"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:01.000002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.999951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4z49\" (UniqueName: \"kubernetes.io/projected/84b23144-10e7-49e3-87d8-bbac53e8f183-kube-api-access-d4z49\") pod \"payload-processing-5b54b7fbb7-tpc7d\" (UID: \"84b23144-10e7-49e3-87d8-bbac53e8f183\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.000002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:00.999977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b23144-10e7-49e3-87d8-bbac53e8f183-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-tpc7d\" (UID: \"84b23144-10e7-49e3-87d8-bbac53e8f183\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.000634 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.000612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc4fcfd-fca7-4bf9-8234-a7d0291e9529-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2cjnv\" (UID: \"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:01.012736 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.012714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8n8\" (UniqueName: \"kubernetes.io/projected/6cc4fcfd-fca7-4bf9-8234-a7d0291e9529-kube-api-access-pr8n8\") pod \"payload-pre-processing-59fbc47bf8-2cjnv\" (UID: \"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:01.101426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.101390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4z49\" (UniqueName: \"kubernetes.io/projected/84b23144-10e7-49e3-87d8-bbac53e8f183-kube-api-access-d4z49\") pod \"payload-processing-5b54b7fbb7-tpc7d\" (UID: \"84b23144-10e7-49e3-87d8-bbac53e8f183\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.101426 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.101428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b23144-10e7-49e3-87d8-bbac53e8f183-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-tpc7d\" (UID: \"84b23144-10e7-49e3-87d8-bbac53e8f183\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.102074 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.102055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b23144-10e7-49e3-87d8-bbac53e8f183-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-tpc7d\" (UID: \"84b23144-10e7-49e3-87d8-bbac53e8f183\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.111153 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.111102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4z49\" (UniqueName: \"kubernetes.io/projected/84b23144-10e7-49e3-87d8-bbac53e8f183-kube-api-access-d4z49\") pod \"payload-processing-5b54b7fbb7-tpc7d\" (UID: \"84b23144-10e7-49e3-87d8-bbac53e8f183\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.175808 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.175781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:01.210500 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.210477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:01.295504 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.295474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp" event={"ID":"7dfa90d7-b1ca-47a1-936a-045f9b4f5297","Type":"ContainerStarted","Data":"18921664793e67b24c00e345976dd75a32eeb14adcc65c3f33557a0df944af38"}
Sep 10 11:24:01.452602 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.452577    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"]
Sep 10 11:24:01.454916 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:24:01.454893    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc4fcfd_fca7_4bf9_8234_a7d0291e9529.slice/crio-1905f88e0aee404c65d697cdb3a1f17091ddc862d38d515da099013111c51021 WatchSource:0}: Error finding container 1905f88e0aee404c65d697cdb3a1f17091ddc862d38d515da099013111c51021: Status 404 returned error can't find the container with id 1905f88e0aee404c65d697cdb3a1f17091ddc862d38d515da099013111c51021
Sep 10 11:24:01.487007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:01.486984    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"]
Sep 10 11:24:01.487758 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:24:01.487735    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b23144_10e7_49e3_87d8_bbac53e8f183.slice/crio-398617d5701bc4ced482adce990eeaf2aeb59ed3224aa22bd70c5511361121a6 WatchSource:0}: Error finding container 398617d5701bc4ced482adce990eeaf2aeb59ed3224aa22bd70c5511361121a6: Status 404 returned error can't find the container with id 398617d5701bc4ced482adce990eeaf2aeb59ed3224aa22bd70c5511361121a6
Sep 10 11:24:02.306351 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:02.306242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv" event={"ID":"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529","Type":"ContainerStarted","Data":"1905f88e0aee404c65d697cdb3a1f17091ddc862d38d515da099013111c51021"}
Sep 10 11:24:02.308565 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:02.308511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d" event={"ID":"84b23144-10e7-49e3-87d8-bbac53e8f183","Type":"ContainerStarted","Data":"398617d5701bc4ced482adce990eeaf2aeb59ed3224aa22bd70c5511361121a6"}
Sep 10 11:24:03.317579 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:03.317510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp" event={"ID":"7dfa90d7-b1ca-47a1-936a-045f9b4f5297","Type":"ContainerStarted","Data":"ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643"}
Sep 10 11:24:03.318071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:03.317799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:03.336858 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:03.336791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp" podStartSLOduration=1.612155628 podStartE2EDuration="3.336771063s" totalImagesPullingTime="1.724615435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:24:03.336433898 +0000 UTC m=+567.430635561" watchObservedRunningTime="2026-09-10 11:24:03.336771063 +0000 UTC m=+567.430972724"
Sep 10 11:24:04.324189 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:04.324151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv" event={"ID":"6cc4fcfd-fca7-4bf9-8234-a7d0291e9529","Type":"ContainerStarted","Data":"00d29ccb1b2691707fe888c1b53f6295cde0d189dc301fdd10ea305289710d70"}
Sep 10 11:24:04.324647 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:04.324220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:04.325889 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:04.325864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d" event={"ID":"84b23144-10e7-49e3-87d8-bbac53e8f183","Type":"ContainerStarted","Data":"1ce0e11a3a7100d81df6014a85521c6df18628315afb6a4baca07acf930afea6"}
Sep 10 11:24:04.326104 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:04.326090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:04.342325 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:04.342285    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv" podStartSLOduration=2.217005238 podStartE2EDuration="4.342271054s" totalImagesPullingTime="2.125265816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:24:04.341079793 +0000 UTC m=+568.435281463" watchObservedRunningTime="2026-09-10 11:24:04.342271054 +0000 UTC m=+568.436472713"
Sep 10 11:24:04.358968 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:04.358917    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d" podStartSLOduration=2.260258548 podStartE2EDuration="4.358899035s" totalImagesPullingTime="2.098640487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:24:04.358787516 +0000 UTC m=+568.452989177" watchObservedRunningTime="2026-09-10 11:24:04.358899035 +0000 UTC m=+568.453100697"
Sep 10 11:24:09.331449 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:09.331416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:24:15.333414 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:15.333387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv"
Sep 10 11:24:15.333770 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:15.333458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-tpc7d"
Sep 10 11:24:31.240161 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.240123    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"]
Sep 10 11:24:31.243625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.243608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.246448 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.246426    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 11:24:31.246596 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.246429    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 11:24:31.247473 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.247454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 11:24:31.247599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.247458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5ft7p\""
Sep 10 11:24:31.253004 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.252979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"]
Sep 10 11:24:31.351613 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.351586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.351779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.351626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe848940-a11c-41d6-8258-bed5acfbf5ca-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.351779 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.351735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6sw9\" (UniqueName: \"kubernetes.io/projected/fe848940-a11c-41d6-8258-bed5acfbf5ca-kube-api-access-v6sw9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.351916 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.351783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.351916 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.351849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.351916 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.351881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453222 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe848940-a11c-41d6-8258-bed5acfbf5ca-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6sw9\" (UniqueName: \"kubernetes.io/projected/fe848940-a11c-41d6-8258-bed5acfbf5ca-kube-api-access-v6sw9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453718 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453790 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.453790 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.453752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.455758 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.455737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe848940-a11c-41d6-8258-bed5acfbf5ca-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.455947 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.455930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe848940-a11c-41d6-8258-bed5acfbf5ca-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.463675 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.463654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6sw9\" (UniqueName: \"kubernetes.io/projected/fe848940-a11c-41d6-8258-bed5acfbf5ca-kube-api-access-v6sw9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m5zln\" (UID: \"fe848940-a11c-41d6-8258-bed5acfbf5ca\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.554721 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.554669    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:31.833628 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:31.833596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"]
Sep 10 11:24:31.837565 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:24:31.835651    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe848940_a11c_41d6_8258_bed5acfbf5ca.slice/crio-41e060e4e33837a00d6a931586a999fe490c1fe7f9bfc6dbcb7d34966d6f278c WatchSource:0}: Error finding container 41e060e4e33837a00d6a931586a999fe490c1fe7f9bfc6dbcb7d34966d6f278c: Status 404 returned error can't find the container with id 41e060e4e33837a00d6a931586a999fe490c1fe7f9bfc6dbcb7d34966d6f278c
Sep 10 11:24:32.482856 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:32.482813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln" event={"ID":"fe848940-a11c-41d6-8258-bed5acfbf5ca","Type":"ContainerStarted","Data":"41e060e4e33837a00d6a931586a999fe490c1fe7f9bfc6dbcb7d34966d6f278c"}
Sep 10 11:24:33.490543 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:33.490499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln" event={"ID":"fe848940-a11c-41d6-8258-bed5acfbf5ca","Type":"ContainerStarted","Data":"b03fd26efad657dd006e90b18a2cd98b960baf3aa4b313b1f908cee24c0df223"}
Sep 10 11:24:33.512626 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:33.512570    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln" podStartSLOduration=1.3902564800000001 podStartE2EDuration="2.512556193s" totalImagesPullingTime="1.122299713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:24:33.510714031 +0000 UTC m=+597.604915693" watchObservedRunningTime="2026-09-10 11:24:33.512556193 +0000 UTC m=+597.606757847"
Sep 10 11:24:41.555212 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:41.555178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:41.557635 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:41.555283    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:41.567789 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:41.567771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:42.548029 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:42.547993    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m5zln"
Sep 10 11:24:55.056522 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.056486    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"]
Sep 10 11:24:55.060113 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.060093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.062875 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.062858    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 11:24:55.071319 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.071298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"]
Sep 10 11:24:55.149612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.149574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.149612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.149613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gnsj\" (UniqueName: \"kubernetes.io/projected/b71f0978-9676-49e7-b819-2db3e06a4b41-kube-api-access-2gnsj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.149803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.149644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.149803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.149730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b71f0978-9676-49e7-b819-2db3e06a4b41-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.149803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.149757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.149803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.149795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.250969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsj\" (UniqueName: \"kubernetes.io/projected/b71f0978-9676-49e7-b819-2db3e06a4b41-kube-api-access-2gnsj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251137 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b71f0978-9676-49e7-b819-2db3e06a4b41-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251335 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251395 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251450 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.251519 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.251494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.253450 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.253424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b71f0978-9676-49e7-b819-2db3e06a4b41-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.253569 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.253499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b71f0978-9676-49e7-b819-2db3e06a4b41-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.259724 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.259705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gnsj\" (UniqueName: \"kubernetes.io/projected/b71f0978-9676-49e7-b819-2db3e06a4b41-kube-api-access-2gnsj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mmc47\" (UID: \"b71f0978-9676-49e7-b819-2db3e06a4b41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.370207 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.370128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:24:55.644248 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.644221    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"]
Sep 10 11:24:55.645519 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:24:55.645496    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71f0978_9676_49e7_b819_2db3e06a4b41.slice/crio-f0df15d4c4a0155f10d4141e1c29dc950610ad7a50bae5333ce08d54f1b7b69e WatchSource:0}: Error finding container f0df15d4c4a0155f10d4141e1c29dc950610ad7a50bae5333ce08d54f1b7b69e: Status 404 returned error can't find the container with id f0df15d4c4a0155f10d4141e1c29dc950610ad7a50bae5333ce08d54f1b7b69e
Sep 10 11:24:55.647197 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:55.647177    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:24:56.612966 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:56.612927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47" event={"ID":"b71f0978-9676-49e7-b819-2db3e06a4b41","Type":"ContainerStarted","Data":"0065bd408351f3a417297db971f7a2593a18899e5fa5770c275256235889165b"}
Sep 10 11:24:56.613423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:56.612976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47" event={"ID":"b71f0978-9676-49e7-b819-2db3e06a4b41","Type":"ContainerStarted","Data":"f0df15d4c4a0155f10d4141e1c29dc950610ad7a50bae5333ce08d54f1b7b69e"}
Sep 10 11:24:56.635425 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:24:56.635381    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47" podStartSLOduration=1.463441062 podStartE2EDuration="1.635366258s" totalImagesPullingTime="171.925196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:24:56.633857402 +0000 UTC m=+620.728059065" watchObservedRunningTime="2026-09-10 11:24:56.635366258 +0000 UTC m=+620.729567958"
Sep 10 11:25:04.441341 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.441307    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"]
Sep 10 11:25:04.445998 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.445971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.448905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.448885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 11:25:04.454493 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.454470    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"]
Sep 10 11:25:04.538113 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.538076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.538292 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.538161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28xk2\" (UniqueName: \"kubernetes.io/projected/050f541d-ce4b-4484-b2b9-0fd0b97b516e-kube-api-access-28xk2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.538292 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.538182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.538388 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.538299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.538432 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.538405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/050f541d-ce4b-4484-b2b9-0fd0b97b516e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.538470 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.538457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.639689 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.639652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.639866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.639701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.639866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.639829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/050f541d-ce4b-4484-b2b9-0fd0b97b516e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.639866 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.639858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.640111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.639921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.640348 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.640326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28xk2\" (UniqueName: \"kubernetes.io/projected/050f541d-ce4b-4484-b2b9-0fd0b97b516e-kube-api-access-28xk2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.640566 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.640491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.640667 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.640581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.644555 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.640948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.644555 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.643243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/050f541d-ce4b-4484-b2b9-0fd0b97b516e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.648992 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.648968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/050f541d-ce4b-4484-b2b9-0fd0b97b516e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.649465 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.649448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28xk2\" (UniqueName: \"kubernetes.io/projected/050f541d-ce4b-4484-b2b9-0fd0b97b516e-kube-api-access-28xk2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z\" (UID: \"050f541d-ce4b-4484-b2b9-0fd0b97b516e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:04.758415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:04.758376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:05.035894 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.035866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"]
Sep 10 11:25:05.038178 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:25:05.038152    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050f541d_ce4b_4484_b2b9_0fd0b97b516e.slice/crio-9781b5f4427829165019773668434377381a9a0b8be4f3310d1627b95d26ff2e WatchSource:0}: Error finding container 9781b5f4427829165019773668434377381a9a0b8be4f3310d1627b95d26ff2e: Status 404 returned error can't find the container with id 9781b5f4427829165019773668434377381a9a0b8be4f3310d1627b95d26ff2e
Sep 10 11:25:05.370929 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.370860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:25:05.370929 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.370916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:25:05.382712 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.382692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:25:05.662977 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.662880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z" event={"ID":"050f541d-ce4b-4484-b2b9-0fd0b97b516e","Type":"ContainerStarted","Data":"1ab8470a5c4d99587f82f46666eb6f30ac3c229cc1e9eb034a4882a873af7962"}
Sep 10 11:25:05.662977 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.662936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z" event={"ID":"050f541d-ce4b-4484-b2b9-0fd0b97b516e","Type":"ContainerStarted","Data":"9781b5f4427829165019773668434377381a9a0b8be4f3310d1627b95d26ff2e"}
Sep 10 11:25:05.674599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.674574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mmc47"
Sep 10 11:25:05.685996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:05.685952    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z" podStartSLOduration=1.497223554 podStartE2EDuration="1.685938624s" totalImagesPullingTime="188.71507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:25:05.684406907 +0000 UTC m=+629.778608586" watchObservedRunningTime="2026-09-10 11:25:05.685938624 +0000 UTC m=+629.780140283"
Sep 10 11:25:14.759201 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:14.759165    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:14.759706 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:14.759263    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:14.771446 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:14.771427    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:25:15.728203 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:25:15.728175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z"
Sep 10 11:26:51.943998 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:51.943915    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"]
Sep 10 11:26:51.946828 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:51.946808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:51.950819 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:51.950797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-8355df-serving-cert\""
Sep 10 11:26:51.964549 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:51.964511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"]
Sep 10 11:26:52.037236 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.037209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-maas-api-tls\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.037380 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.037292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d80dd9-95f7-45ca-be78-66274c7f5f70-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.037469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.037389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdpvr\" (UniqueName: \"kubernetes.io/projected/87d80dd9-95f7-45ca-be78-66274c7f5f70-kube-api-access-kdpvr\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.037469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.037427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-metrics-certs\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.137968 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.137936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdpvr\" (UniqueName: \"kubernetes.io/projected/87d80dd9-95f7-45ca-be78-66274c7f5f70-kube-api-access-kdpvr\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.137968 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.137977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-metrics-certs\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.138216 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.138019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-maas-api-tls\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.138216 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.138095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d80dd9-95f7-45ca-be78-66274c7f5f70-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.138819 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.138792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d80dd9-95f7-45ca-be78-66274c7f5f70-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.140657 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.140631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-metrics-certs\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.140750 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.140682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-maas-api-tls\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.148468 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.148444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdpvr\" (UniqueName: \"kubernetes.io/projected/87d80dd9-95f7-45ca-be78-66274c7f5f70-kube-api-access-kdpvr\") pod \"maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.257423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.257396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:52.530126 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:52.530099    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"]
Sep 10 11:26:52.531075 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:26:52.531052    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d80dd9_95f7_45ca_be78_66274c7f5f70.slice/crio-1f366a8a021041215cbc0564bf5bd25c3e840225ed87e711a1fcc82098f9e48a WatchSource:0}: Error finding container 1f366a8a021041215cbc0564bf5bd25c3e840225ed87e711a1fcc82098f9e48a: Status 404 returned error can't find the container with id 1f366a8a021041215cbc0564bf5bd25c3e840225ed87e711a1fcc82098f9e48a
Sep 10 11:26:53.256075 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:53.256039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8" event={"ID":"87d80dd9-95f7-45ca-be78-66274c7f5f70","Type":"ContainerStarted","Data":"df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4"}
Sep 10 11:26:53.256477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:53.256100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8" event={"ID":"87d80dd9-95f7-45ca-be78-66274c7f5f70","Type":"ContainerStarted","Data":"1f366a8a021041215cbc0564bf5bd25c3e840225ed87e711a1fcc82098f9e48a"}
Sep 10 11:26:53.256477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:53.256130    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:26:53.279525 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:53.279478    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8" podStartSLOduration=1.741931938 podStartE2EDuration="2.279461625s" totalImagesPullingTime="537.529687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:26:53.278468438 +0000 UTC m=+737.372670097" watchObservedRunningTime="2026-09-10 11:26:53.279461625 +0000 UTC m=+737.373663284"
Sep 10 11:26:59.268483 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:26:59.268453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:27:00.324619 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.324587    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"]
Sep 10 11:27:00.329139 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.329118    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.331997 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.331975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aff377da-serving-cert\""
Sep 10 11:27:00.341090 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.341066    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"]
Sep 10 11:27:00.412737 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.412711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-metrics-certs\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.412905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.412747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c523b880-7dc0-4127-9d5f-26c1c7408749-openshift-service-ca\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.412905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.412782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97ft9\" (UniqueName: \"kubernetes.io/projected/c523b880-7dc0-4127-9d5f-26c1c7408749-kube-api-access-97ft9\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.412905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.412882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-maas-api-tls\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.513550 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.513501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-metrics-certs\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.513735 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.513712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c523b880-7dc0-4127-9d5f-26c1c7408749-openshift-service-ca\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.513816 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.513779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ft9\" (UniqueName: \"kubernetes.io/projected/c523b880-7dc0-4127-9d5f-26c1c7408749-kube-api-access-97ft9\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.513942 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.513921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-maas-api-tls\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.514405 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.514381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c523b880-7dc0-4127-9d5f-26c1c7408749-openshift-service-ca\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.516344 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.516291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-metrics-certs\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.516703 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.516685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-maas-api-tls\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.526542 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.526499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97ft9\" (UniqueName: \"kubernetes.io/projected/c523b880-7dc0-4127-9d5f-26c1c7408749-kube-api-access-97ft9\") pod \"maas-api-e2e-ait-aff377da-7474dc949b-77x7h\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.643434 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.643371    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:00.918482 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:00.918458    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"]
Sep 10 11:27:00.919888 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:27:00.919863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc523b880_7dc0_4127_9d5f_26c1c7408749.slice/crio-243544afd4ee6631c3b09e28d832d029a2f9168e9a4e4d9df9eb80674de4185f WatchSource:0}: Error finding container 243544afd4ee6631c3b09e28d832d029a2f9168e9a4e4d9df9eb80674de4185f: Status 404 returned error can't find the container with id 243544afd4ee6631c3b09e28d832d029a2f9168e9a4e4d9df9eb80674de4185f
Sep 10 11:27:01.303913 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:01.303881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h" event={"ID":"c523b880-7dc0-4127-9d5f-26c1c7408749","Type":"ContainerStarted","Data":"243544afd4ee6631c3b09e28d832d029a2f9168e9a4e4d9df9eb80674de4185f"}
Sep 10 11:27:02.310905 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.310872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h" event={"ID":"c523b880-7dc0-4127-9d5f-26c1c7408749","Type":"ContainerStarted","Data":"527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148"}
Sep 10 11:27:02.311280 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.310945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:02.335038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.334993    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h" podStartSLOduration=1.8026347999999999 podStartE2EDuration="2.334980014s" totalImagesPullingTime="532.345214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:27:02.332932159 +0000 UTC m=+746.427133819" watchObservedRunningTime="2026-09-10 11:27:02.334980014 +0000 UTC m=+746.429181680"
Sep 10 11:27:02.954768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.954730    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"]
Sep 10 11:27:02.958575 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.958551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:02.962227 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.962207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-8de26b-serving-cert\""
Sep 10 11:27:02.981283 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:02.981257    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"]
Sep 10 11:27:03.036364 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.036333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-metrics-certs\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.036481 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.036404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdz4d\" (UniqueName: \"kubernetes.io/projected/3e397343-6297-4506-91bd-3fa6f95b3200-kube-api-access-fdz4d\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.036481 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.036455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.036603 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.036575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e397343-6297-4506-91bd-3fa6f95b3200-openshift-service-ca\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.137846 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.137810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e397343-6297-4506-91bd-3fa6f95b3200-openshift-service-ca\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.138009 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.137884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-metrics-certs\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.138009 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.137915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdz4d\" (UniqueName: \"kubernetes.io/projected/3e397343-6297-4506-91bd-3fa6f95b3200-kube-api-access-fdz4d\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.138009 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.137993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.138180 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:27:03.138162    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-serving-cert: secret "maas-api-e2e-autores-8de26b-serving-cert" not found
Sep 10 11:27:03.138235 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:27:03.138216    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls podName:3e397343-6297-4506-91bd-3fa6f95b3200 nodeName:}" failed. No retries permitted until 2026-09-10 11:27:03.638200605 +0000 UTC m=+747.732402242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls") pod "maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" (UID: "3e397343-6297-4506-91bd-3fa6f95b3200") : secret "maas-api-e2e-autores-8de26b-serving-cert" not found
Sep 10 11:27:03.138457 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.138434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e397343-6297-4506-91bd-3fa6f95b3200-openshift-service-ca\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.140683 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.140656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-metrics-certs\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.151320 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.151294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdz4d\" (UniqueName: \"kubernetes.io/projected/3e397343-6297-4506-91bd-3fa6f95b3200-kube-api-access-fdz4d\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.641624 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.641594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.644214 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.644189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls\") pod \"maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:03.871355 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:03.871324    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:04.149257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:04.149226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"]
Sep 10 11:27:04.150794 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:27:04.150769    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e397343_6297_4506_91bd_3fa6f95b3200.slice/crio-993313d777a683483f7dd80349a11fd356453a8ad16775af00afc86953cd7ac8 WatchSource:0}: Error finding container 993313d777a683483f7dd80349a11fd356453a8ad16775af00afc86953cd7ac8: Status 404 returned error can't find the container with id 993313d777a683483f7dd80349a11fd356453a8ad16775af00afc86953cd7ac8
Sep 10 11:27:04.325734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:04.325699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" event={"ID":"3e397343-6297-4506-91bd-3fa6f95b3200","Type":"ContainerStarted","Data":"993313d777a683483f7dd80349a11fd356453a8ad16775af00afc86953cd7ac8"}
Sep 10 11:27:05.332705 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:05.332656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" event={"ID":"3e397343-6297-4506-91bd-3fa6f95b3200","Type":"ContainerStarted","Data":"5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe"}
Sep 10 11:27:05.333185 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:05.332806    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:05.353117 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:05.353054    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" podStartSLOduration=2.913731583 podStartE2EDuration="3.353039711s" totalImagesPullingTime="439.308128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:27:05.351449326 +0000 UTC m=+749.445650987" watchObservedRunningTime="2026-09-10 11:27:05.353039711 +0000 UTC m=+749.447241429"
Sep 10 11:27:08.321738 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:08.321703    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:11.345443 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:11.345414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:27:21.124738 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.124703    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"]
Sep 10 11:27:21.129612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.129591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.133338 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.133314    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4c9990-serving-cert\""
Sep 10 11:27:21.160468 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.160446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"]
Sep 10 11:27:21.306794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.306765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820ede9c-877d-4962-8f8b-5003b75b6929-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.306965 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.306822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-metrics-certs\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.306965 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.306876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf8d9\" (UniqueName: \"kubernetes.io/projected/820ede9c-877d-4962-8f8b-5003b75b6929-kube-api-access-xf8d9\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.307049 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.307000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-maas-api-tls\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.407797 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.407715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-maas-api-tls\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.407797 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.407778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820ede9c-877d-4962-8f8b-5003b75b6929-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.408014 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.407852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-metrics-certs\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.408014 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.407970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf8d9\" (UniqueName: \"kubernetes.io/projected/820ede9c-877d-4962-8f8b-5003b75b6929-kube-api-access-xf8d9\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.408515 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.408493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820ede9c-877d-4962-8f8b-5003b75b6929-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.410320 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.410288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-maas-api-tls\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.410458 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.410443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-metrics-certs\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.421211 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.421190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf8d9\" (UniqueName: \"kubernetes.io/projected/820ede9c-877d-4962-8f8b-5003b75b6929-kube-api-access-xf8d9\") pod \"maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.439713 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.439692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:21.719951 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:21.719927    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"]
Sep 10 11:27:21.720384 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:27:21.720352    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820ede9c_877d_4962_8f8b_5003b75b6929.slice/crio-c56b8138e18706abbc8e871ead1da61ebe6a07ed2a65c13e1d384b3dbc894a1d WatchSource:0}: Error finding container c56b8138e18706abbc8e871ead1da61ebe6a07ed2a65c13e1d384b3dbc894a1d: Status 404 returned error can't find the container with id c56b8138e18706abbc8e871ead1da61ebe6a07ed2a65c13e1d384b3dbc894a1d
Sep 10 11:27:22.445899 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:22.445866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l" event={"ID":"820ede9c-877d-4962-8f8b-5003b75b6929","Type":"ContainerStarted","Data":"c56b8138e18706abbc8e871ead1da61ebe6a07ed2a65c13e1d384b3dbc894a1d"}
Sep 10 11:27:23.454472 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:23.454441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l" event={"ID":"820ede9c-877d-4962-8f8b-5003b75b6929","Type":"ContainerStarted","Data":"3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809"}
Sep 10 11:27:23.455002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:23.454588    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:23.479930 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:23.479889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l" podStartSLOduration=1.767820102 podStartE2EDuration="2.479873857s" totalImagesPullingTime="712.053755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:27:23.47906082 +0000 UTC m=+767.573262481" watchObservedRunningTime="2026-09-10 11:27:23.479873857 +0000 UTC m=+767.574075517"
Sep 10 11:27:29.465727 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:29.465695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:27:41.196773 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.196740    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"]
Sep 10 11:27:41.197305 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.196991    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h" podUID="c523b880-7dc0-4127-9d5f-26c1c7408749" containerName="maas-api" containerID="cri-o://527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148" gracePeriod=30
Sep 10 11:27:41.466802 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.466770    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:41.555599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.555571    2580 generic.go:356] "Generic (PLEG): container finished" podID="c523b880-7dc0-4127-9d5f-26c1c7408749" containerID="527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148" exitCode=0
Sep 10 11:27:41.555777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.555617    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"
Sep 10 11:27:41.555777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.555627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h" event={"ID":"c523b880-7dc0-4127-9d5f-26c1c7408749","Type":"ContainerDied","Data":"527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148"}
Sep 10 11:27:41.555777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.555681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h" event={"ID":"c523b880-7dc0-4127-9d5f-26c1c7408749","Type":"ContainerDied","Data":"243544afd4ee6631c3b09e28d832d029a2f9168e9a4e4d9df9eb80674de4185f"}
Sep 10 11:27:41.555777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.555711    2580 scope.go:117] "RemoveContainer" containerID="527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148"
Sep 10 11:27:41.565515 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.565498    2580 scope.go:117] "RemoveContainer" containerID="527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148"
Sep 10 11:27:41.565840 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:27:41.565816    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148\": container with ID starting with 527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148 not found: ID does not exist" containerID="527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148"
Sep 10 11:27:41.565954 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.565847    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148"} err="failed to get container status \"527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148\": rpc error: code = NotFound desc = could not find container \"527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148\": container with ID starting with 527c62fc086a0b16e99dc067e5bd9d7cbdd926aee305ba309e997a5b227bb148 not found: ID does not exist"
Sep 10 11:27:41.589662 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.589635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97ft9\" (UniqueName: \"kubernetes.io/projected/c523b880-7dc0-4127-9d5f-26c1c7408749-kube-api-access-97ft9\") pod \"c523b880-7dc0-4127-9d5f-26c1c7408749\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") "
Sep 10 11:27:41.589769 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.589670    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-maas-api-tls\") pod \"c523b880-7dc0-4127-9d5f-26c1c7408749\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") "
Sep 10 11:27:41.589769 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.589716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c523b880-7dc0-4127-9d5f-26c1c7408749-openshift-service-ca\") pod \"c523b880-7dc0-4127-9d5f-26c1c7408749\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") "
Sep 10 11:27:41.589875 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.589816    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-metrics-certs\") pod \"c523b880-7dc0-4127-9d5f-26c1c7408749\" (UID: \"c523b880-7dc0-4127-9d5f-26c1c7408749\") "
Sep 10 11:27:41.590152 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.590126    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c523b880-7dc0-4127-9d5f-26c1c7408749-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c523b880-7dc0-4127-9d5f-26c1c7408749" (UID: "c523b880-7dc0-4127-9d5f-26c1c7408749"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:27:41.591895 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.591874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c523b880-7dc0-4127-9d5f-26c1c7408749-kube-api-access-97ft9" (OuterVolumeSpecName: "kube-api-access-97ft9") pod "c523b880-7dc0-4127-9d5f-26c1c7408749" (UID: "c523b880-7dc0-4127-9d5f-26c1c7408749"). InnerVolumeSpecName "kube-api-access-97ft9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:27:41.591966 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.591924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c523b880-7dc0-4127-9d5f-26c1c7408749" (UID: "c523b880-7dc0-4127-9d5f-26c1c7408749"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:27:41.592007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.591966    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c523b880-7dc0-4127-9d5f-26c1c7408749" (UID: "c523b880-7dc0-4127-9d5f-26c1c7408749"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:27:41.691503 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.691480    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97ft9\" (UniqueName: \"kubernetes.io/projected/c523b880-7dc0-4127-9d5f-26c1c7408749-kube-api-access-97ft9\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:27:41.691503 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.691505    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:27:41.691681 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.691514    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c523b880-7dc0-4127-9d5f-26c1c7408749-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:27:41.691681 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.691522    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c523b880-7dc0-4127-9d5f-26c1c7408749-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:27:41.889000 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.888970    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"]
Sep 10 11:27:41.897369 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:41.897347    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff377da-7474dc949b-77x7h"]
Sep 10 11:27:42.419153 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:42.419122    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c523b880-7dc0-4127-9d5f-26c1c7408749" path="/var/lib/kubelet/pods/c523b880-7dc0-4127-9d5f-26c1c7408749/volumes"
Sep 10 11:27:45.687672 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.687641    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"]
Sep 10 11:27:45.688246 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.688232    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c523b880-7dc0-4127-9d5f-26c1c7408749" containerName="maas-api"
Sep 10 11:27:45.688287 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.688249    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c523b880-7dc0-4127-9d5f-26c1c7408749" containerName="maas-api"
Sep 10 11:27:45.688332 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.688324    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c523b880-7dc0-4127-9d5f-26c1c7408749" containerName="maas-api"
Sep 10 11:27:45.693169 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.693150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.705881 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.705863    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-913c8e9c-serving-cert\""
Sep 10 11:27:45.732375 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.732350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"]
Sep 10 11:27:45.833367 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.833335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d0e906-ed40-426b-ad4a-695ab2240dd0-openshift-service-ca\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.833676 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.833653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-metrics-certs\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.833810 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.833796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-maas-api-tls\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.833969 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.833954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l94rt\" (UniqueName: \"kubernetes.io/projected/f0d0e906-ed40-426b-ad4a-695ab2240dd0-kube-api-access-l94rt\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.934981 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.934953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-metrics-certs\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.935122 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.934986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-maas-api-tls\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.935178 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.935123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l94rt\" (UniqueName: \"kubernetes.io/projected/f0d0e906-ed40-426b-ad4a-695ab2240dd0-kube-api-access-l94rt\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.935254 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.935235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d0e906-ed40-426b-ad4a-695ab2240dd0-openshift-service-ca\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.935865 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.935842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d0e906-ed40-426b-ad4a-695ab2240dd0-openshift-service-ca\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.937594 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.937563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-metrics-certs\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.937709 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.937600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-maas-api-tls\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:45.944152 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:45.944129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l94rt\" (UniqueName: \"kubernetes.io/projected/f0d0e906-ed40-426b-ad4a-695ab2240dd0-kube-api-access-l94rt\") pod \"maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:46.003305 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:46.003280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:46.294923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:46.294892    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"]
Sep 10 11:27:46.296240 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:27:46.296211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d0e906_ed40_426b_ad4a_695ab2240dd0.slice/crio-5f825c80f3585ccaf6107cb2331c5981c1b95740518c575c5e0c23158734f34a WatchSource:0}: Error finding container 5f825c80f3585ccaf6107cb2331c5981c1b95740518c575c5e0c23158734f34a: Status 404 returned error can't find the container with id 5f825c80f3585ccaf6107cb2331c5981c1b95740518c575c5e0c23158734f34a
Sep 10 11:27:46.586554 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:46.586456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll" event={"ID":"f0d0e906-ed40-426b-ad4a-695ab2240dd0","Type":"ContainerStarted","Data":"5f825c80f3585ccaf6107cb2331c5981c1b95740518c575c5e0c23158734f34a"}
Sep 10 11:27:47.594233 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:47.594188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll" event={"ID":"f0d0e906-ed40-426b-ad4a-695ab2240dd0","Type":"ContainerStarted","Data":"6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e"}
Sep 10 11:27:47.594719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:47.594306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:27:47.624193 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:47.624145    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll" podStartSLOduration=2.116326086 podStartE2EDuration="2.624130277s" totalImagesPullingTime="507.804191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:27:47.621643682 +0000 UTC m=+791.715845353" watchObservedRunningTime="2026-09-10 11:27:47.624130277 +0000 UTC m=+791.718331937"
Sep 10 11:27:53.604915 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:27:53.604883    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:28:17.114744 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.114714    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"]
Sep 10 11:28:17.115180 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.114904    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll" podUID="f0d0e906-ed40-426b-ad4a-695ab2240dd0" containerName="maas-api" containerID="cri-o://6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e" gracePeriod=30
Sep 10 11:28:17.389251 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.389225    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:28:17.516148 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.516117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d0e906-ed40-426b-ad4a-695ab2240dd0-openshift-service-ca\") pod \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") "
Sep 10 11:28:17.516317 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.516176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l94rt\" (UniqueName: \"kubernetes.io/projected/f0d0e906-ed40-426b-ad4a-695ab2240dd0-kube-api-access-l94rt\") pod \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") "
Sep 10 11:28:17.516317 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.516223    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-metrics-certs\") pod \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") "
Sep 10 11:28:17.516317 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.516282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-maas-api-tls\") pod \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\" (UID: \"f0d0e906-ed40-426b-ad4a-695ab2240dd0\") "
Sep 10 11:28:17.516472 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.516449    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0d0e906-ed40-426b-ad4a-695ab2240dd0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0d0e906-ed40-426b-ad4a-695ab2240dd0" (UID: "f0d0e906-ed40-426b-ad4a-695ab2240dd0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:28:17.516760 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.516625    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0d0e906-ed40-426b-ad4a-695ab2240dd0-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:17.518492 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.518461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0d0e906-ed40-426b-ad4a-695ab2240dd0" (UID: "f0d0e906-ed40-426b-ad4a-695ab2240dd0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:28:17.518621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.518514    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0d0e906-ed40-426b-ad4a-695ab2240dd0-kube-api-access-l94rt" (OuterVolumeSpecName: "kube-api-access-l94rt") pod "f0d0e906-ed40-426b-ad4a-695ab2240dd0" (UID: "f0d0e906-ed40-426b-ad4a-695ab2240dd0"). InnerVolumeSpecName "kube-api-access-l94rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:28:17.518621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.518562    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0d0e906-ed40-426b-ad4a-695ab2240dd0" (UID: "f0d0e906-ed40-426b-ad4a-695ab2240dd0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:28:17.617423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.617350    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l94rt\" (UniqueName: \"kubernetes.io/projected/f0d0e906-ed40-426b-ad4a-695ab2240dd0-kube-api-access-l94rt\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:17.617423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.617379    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:17.617423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.617388    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0d0e906-ed40-426b-ad4a-695ab2240dd0-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:17.770697 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.770664    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0d0e906-ed40-426b-ad4a-695ab2240dd0" containerID="6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e" exitCode=0
Sep 10 11:28:17.770872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.770715    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"
Sep 10 11:28:17.770872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.770719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll" event={"ID":"f0d0e906-ed40-426b-ad4a-695ab2240dd0","Type":"ContainerDied","Data":"6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e"}
Sep 10 11:28:17.770872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.770774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll" event={"ID":"f0d0e906-ed40-426b-ad4a-695ab2240dd0","Type":"ContainerDied","Data":"5f825c80f3585ccaf6107cb2331c5981c1b95740518c575c5e0c23158734f34a"}
Sep 10 11:28:17.770872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.770804    2580 scope.go:117] "RemoveContainer" containerID="6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e"
Sep 10 11:28:17.780927 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.780912    2580 scope.go:117] "RemoveContainer" containerID="6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e"
Sep 10 11:28:17.781203 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:28:17.781179    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e\": container with ID starting with 6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e not found: ID does not exist" containerID="6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e"
Sep 10 11:28:17.781317 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.781208    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e"} err="failed to get container status \"6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e\": rpc error: code = NotFound desc = could not find container \"6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e\": container with ID starting with 6a873f1e9161cb511697ecfe82915e166a6134f25e3f20694cd51b8f5b1dc86e not found: ID does not exist"
Sep 10 11:28:17.796157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.796135    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"]
Sep 10 11:28:17.802117 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:17.802095    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-913c8e9c-7668cb884f-72lll"]
Sep 10 11:28:18.422796 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:18.422758    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0d0e906-ed40-426b-ad4a-695ab2240dd0" path="/var/lib/kubelet/pods/f0d0e906-ed40-426b-ad4a-695ab2240dd0/volumes"
Sep 10 11:28:21.841285 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.841252    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"]
Sep 10 11:28:21.841982 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.841957    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0d0e906-ed40-426b-ad4a-695ab2240dd0" containerName="maas-api"
Sep 10 11:28:21.842078 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.841985    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0d0e906-ed40-426b-ad4a-695ab2240dd0" containerName="maas-api"
Sep 10 11:28:21.842150 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.842092    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0d0e906-ed40-426b-ad4a-695ab2240dd0" containerName="maas-api"
Sep 10 11:28:21.846850 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.846825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:21.849722 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.849690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-54215d39-serving-cert\""
Sep 10 11:28:21.857780 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.857602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"]
Sep 10 11:28:21.960419 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.960386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc6d5104-9e13-45df-883c-152ac452a233-openshift-service-ca\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:21.960659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.960513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7d7\" (UniqueName: \"kubernetes.io/projected/dc6d5104-9e13-45df-883c-152ac452a233-kube-api-access-wf7d7\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:21.960659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.960564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:21.960659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:21.960603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-metrics-certs\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.061331 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.061295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7d7\" (UniqueName: \"kubernetes.io/projected/dc6d5104-9e13-45df-883c-152ac452a233-kube-api-access-wf7d7\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.061331 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.061335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.061602 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.061380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-metrics-certs\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.061602 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.061430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc6d5104-9e13-45df-883c-152ac452a233-openshift-service-ca\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.061602 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:28:22.061521    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-serving-cert: secret "maas-api-e2e-ait-54215d39-serving-cert" not found
Sep 10 11:28:22.061767 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:28:22.061624    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls podName:dc6d5104-9e13-45df-883c-152ac452a233 nodeName:}" failed. No retries permitted until 2026-09-10 11:28:22.561603177 +0000 UTC m=+826.655804831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls") pod "maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" (UID: "dc6d5104-9e13-45df-883c-152ac452a233") : secret "maas-api-e2e-ait-54215d39-serving-cert" not found
Sep 10 11:28:22.062193 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.062174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc6d5104-9e13-45df-883c-152ac452a233-openshift-service-ca\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.064033 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.064009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-metrics-certs\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.070728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.070701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7d7\" (UniqueName: \"kubernetes.io/projected/dc6d5104-9e13-45df-883c-152ac452a233-kube-api-access-wf7d7\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.566477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.566444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.569248 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.569219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls\") pod \"maas-api-e2e-ait-54215d39-768759dfdd-lhfnd\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:22.761806 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:22.761772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:23.041689 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:23.041663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"]
Sep 10 11:28:23.042967 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:28:23.042942    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6d5104_9e13_45df_883c_152ac452a233.slice/crio-49b494801a24aad6533ddfdb5a4cdc8e3e3a2bafa26abf721754f4b4127ee860 WatchSource:0}: Error finding container 49b494801a24aad6533ddfdb5a4cdc8e3e3a2bafa26abf721754f4b4127ee860: Status 404 returned error can't find the container with id 49b494801a24aad6533ddfdb5a4cdc8e3e3a2bafa26abf721754f4b4127ee860
Sep 10 11:28:23.810327 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:23.810292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" event={"ID":"dc6d5104-9e13-45df-883c-152ac452a233","Type":"ContainerStarted","Data":"20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a"}
Sep 10 11:28:23.810462 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:23.810358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" event={"ID":"dc6d5104-9e13-45df-883c-152ac452a233","Type":"ContainerStarted","Data":"49b494801a24aad6533ddfdb5a4cdc8e3e3a2bafa26abf721754f4b4127ee860"}
Sep 10 11:28:23.810462 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:23.810388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:23.830376 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:23.830335    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" podStartSLOduration=2.165627033 podStartE2EDuration="2.830319841s" totalImagesPullingTime="664.692808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:28:23.829715207 +0000 UTC m=+827.923916873" watchObservedRunningTime="2026-09-10 11:28:23.830319841 +0000 UTC m=+827.924521501"
Sep 10 11:28:29.821237 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:29.821205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:52.366263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.366229    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"]
Sep 10 11:28:52.366663 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.366504    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" podUID="dc6d5104-9e13-45df-883c-152ac452a233" containerName="maas-api" containerID="cri-o://20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a" gracePeriod=30
Sep 10 11:28:52.634949 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.634928    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:52.727720 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.727695    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf7d7\" (UniqueName: \"kubernetes.io/projected/dc6d5104-9e13-45df-883c-152ac452a233-kube-api-access-wf7d7\") pod \"dc6d5104-9e13-45df-883c-152ac452a233\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") "
Sep 10 11:28:52.727936 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.727732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc6d5104-9e13-45df-883c-152ac452a233-openshift-service-ca\") pod \"dc6d5104-9e13-45df-883c-152ac452a233\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") "
Sep 10 11:28:52.727936 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.727787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls\") pod \"dc6d5104-9e13-45df-883c-152ac452a233\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") "
Sep 10 11:28:52.727936 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.727859    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-metrics-certs\") pod \"dc6d5104-9e13-45df-883c-152ac452a233\" (UID: \"dc6d5104-9e13-45df-883c-152ac452a233\") "
Sep 10 11:28:52.728209 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.728173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc6d5104-9e13-45df-883c-152ac452a233-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc6d5104-9e13-45df-883c-152ac452a233" (UID: "dc6d5104-9e13-45df-883c-152ac452a233"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:28:52.730101 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.730075    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc6d5104-9e13-45df-883c-152ac452a233-kube-api-access-wf7d7" (OuterVolumeSpecName: "kube-api-access-wf7d7") pod "dc6d5104-9e13-45df-883c-152ac452a233" (UID: "dc6d5104-9e13-45df-883c-152ac452a233"). InnerVolumeSpecName "kube-api-access-wf7d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:28:52.730210 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.730116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc6d5104-9e13-45df-883c-152ac452a233" (UID: "dc6d5104-9e13-45df-883c-152ac452a233"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:28:52.730210 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.730157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc6d5104-9e13-45df-883c-152ac452a233" (UID: "dc6d5104-9e13-45df-883c-152ac452a233"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:28:52.828820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.828790    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc6d5104-9e13-45df-883c-152ac452a233-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:52.828820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.828815    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:52.828820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.828825    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc6d5104-9e13-45df-883c-152ac452a233-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:52.829028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.828834    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf7d7\" (UniqueName: \"kubernetes.io/projected/dc6d5104-9e13-45df-883c-152ac452a233-kube-api-access-wf7d7\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:28:52.980239 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.980213    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc6d5104-9e13-45df-883c-152ac452a233" containerID="20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a" exitCode=0
Sep 10 11:28:52.980382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.980259    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"
Sep 10 11:28:52.980382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.980304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" event={"ID":"dc6d5104-9e13-45df-883c-152ac452a233","Type":"ContainerDied","Data":"20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a"}
Sep 10 11:28:52.980382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.980353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd" event={"ID":"dc6d5104-9e13-45df-883c-152ac452a233","Type":"ContainerDied","Data":"49b494801a24aad6533ddfdb5a4cdc8e3e3a2bafa26abf721754f4b4127ee860"}
Sep 10 11:28:52.980382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.980376    2580 scope.go:117] "RemoveContainer" containerID="20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a"
Sep 10 11:28:52.990368 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.990349    2580 scope.go:117] "RemoveContainer" containerID="20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a"
Sep 10 11:28:52.990693 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:28:52.990671    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a\": container with ID starting with 20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a not found: ID does not exist" containerID="20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a"
Sep 10 11:28:52.990795 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:52.990698    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a"} err="failed to get container status \"20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a\": rpc error: code = NotFound desc = could not find container \"20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a\": container with ID starting with 20aeecd7903f45ceb60d1892fac06ccf3df7af492883e3ef0897006740ef069a not found: ID does not exist"
Sep 10 11:28:53.006844 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:53.006821    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"]
Sep 10 11:28:53.015756 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:53.015732    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-54215d39-768759dfdd-lhfnd"]
Sep 10 11:28:54.419509 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:54.419477    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc6d5104-9e13-45df-883c-152ac452a233" path="/var/lib/kubelet/pods/dc6d5104-9e13-45df-883c-152ac452a233/volumes"
Sep 10 11:28:58.037911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.037878    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"]
Sep 10 11:28:58.038494 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.038472    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc6d5104-9e13-45df-883c-152ac452a233" containerName="maas-api"
Sep 10 11:28:58.038643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.038496    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc6d5104-9e13-45df-883c-152ac452a233" containerName="maas-api"
Sep 10 11:28:58.038643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.038635    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc6d5104-9e13-45df-883c-152ac452a233" containerName="maas-api"
Sep 10 11:28:58.043385 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.043361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.046464 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.046440    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0024ffd2-serving-cert\""
Sep 10 11:28:58.063065 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.063040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"]
Sep 10 11:28:58.066895 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.066874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dl6j\" (UniqueName: \"kubernetes.io/projected/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-kube-api-access-4dl6j\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.066987 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.066935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-metrics-certs\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.067039 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.066990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.067039 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.067007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-openshift-service-ca\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.168481 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.168448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dl6j\" (UniqueName: \"kubernetes.io/projected/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-kube-api-access-4dl6j\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.168643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.168543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-metrics-certs\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.168643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.168591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.168643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.168616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-openshift-service-ca\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.168782 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:28:58.168712    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-serving-cert: secret "maas-api-e2e-derive-0024ffd2-serving-cert" not found
Sep 10 11:28:58.168782 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:28:58.168770    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls podName:c9bf1df0-8a43-47ab-a638-8ebd97fe7557 nodeName:}" failed. No retries permitted until 2026-09-10 11:28:58.668756048 +0000 UTC m=+862.762957700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls") pod "maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" (UID: "c9bf1df0-8a43-47ab-a638-8ebd97fe7557") : secret "maas-api-e2e-derive-0024ffd2-serving-cert" not found
Sep 10 11:28:58.169361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.169337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-openshift-service-ca\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.171113 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.171080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-metrics-certs\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.177742 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.177722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dl6j\" (UniqueName: \"kubernetes.io/projected/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-kube-api-access-4dl6j\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.674348 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.674312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.677286 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.677261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls\") pod \"maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:58.957714 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:58.957681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:28:59.247362 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:28:59.247332    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"]
Sep 10 11:28:59.249324 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:28:59.249299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9bf1df0_8a43_47ab_a638_8ebd97fe7557.slice/crio-b3036f56d7ee11755cc8425d17968a7bb145194bda16ebbcf17860591633a2fa WatchSource:0}: Error finding container b3036f56d7ee11755cc8425d17968a7bb145194bda16ebbcf17860591633a2fa: Status 404 returned error can't find the container with id b3036f56d7ee11755cc8425d17968a7bb145194bda16ebbcf17860591633a2fa
Sep 10 11:29:00.026884 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:00.026782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" event={"ID":"c9bf1df0-8a43-47ab-a638-8ebd97fe7557","Type":"ContainerStarted","Data":"d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543"}
Sep 10 11:29:00.026884 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:00.026849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" event={"ID":"c9bf1df0-8a43-47ab-a638-8ebd97fe7557","Type":"ContainerStarted","Data":"b3036f56d7ee11755cc8425d17968a7bb145194bda16ebbcf17860591633a2fa"}
Sep 10 11:29:00.027145 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:00.026985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:29:00.054172 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:00.054131    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" podStartSLOduration=1.64723102 podStartE2EDuration="2.054116235s" totalImagesPullingTime="406.885215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:29:00.052254091 +0000 UTC m=+864.146455750" watchObservedRunningTime="2026-09-10 11:29:00.054116235 +0000 UTC m=+864.148317916"
Sep 10 11:29:06.037199 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:06.037169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:29:28.401517 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.401440    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"]
Sep 10 11:29:28.402091 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.401707    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" podUID="c9bf1df0-8a43-47ab-a638-8ebd97fe7557" containerName="maas-api" containerID="cri-o://d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543" gracePeriod=30
Sep 10 11:29:28.598497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.598460    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"]
Sep 10 11:29:28.598852 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.598759    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" podUID="3e397343-6297-4506-91bd-3fa6f95b3200" containerName="maas-api" containerID="cri-o://5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe" gracePeriod=30
Sep 10 11:29:28.723850 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.723817    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:29:28.849338 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.849301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls\") pod \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") "
Sep 10 11:29:28.849513 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.849394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dl6j\" (UniqueName: \"kubernetes.io/projected/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-kube-api-access-4dl6j\") pod \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") "
Sep 10 11:29:28.849621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.849591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-openshift-service-ca\") pod \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") "
Sep 10 11:29:28.851915 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.850202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-metrics-certs\") pod \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\" (UID: \"c9bf1df0-8a43-47ab-a638-8ebd97fe7557\") "
Sep 10 11:29:28.851915 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.850311    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9bf1df0-8a43-47ab-a638-8ebd97fe7557" (UID: "c9bf1df0-8a43-47ab-a638-8ebd97fe7557"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:29:28.851915 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.850853    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:28.854234 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.852800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-kube-api-access-4dl6j" (OuterVolumeSpecName: "kube-api-access-4dl6j") pod "c9bf1df0-8a43-47ab-a638-8ebd97fe7557" (UID: "c9bf1df0-8a43-47ab-a638-8ebd97fe7557"). InnerVolumeSpecName "kube-api-access-4dl6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:29:28.855294 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.855219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c9bf1df0-8a43-47ab-a638-8ebd97fe7557" (UID: "c9bf1df0-8a43-47ab-a638-8ebd97fe7557"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:29:28.858507 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.858479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9bf1df0-8a43-47ab-a638-8ebd97fe7557" (UID: "c9bf1df0-8a43-47ab-a638-8ebd97fe7557"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:29:28.863768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.863749    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:29:28.951718 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.951645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-metrics-certs\") pod \"3e397343-6297-4506-91bd-3fa6f95b3200\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") "
Sep 10 11:29:28.951863 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.951716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls\") pod \"3e397343-6297-4506-91bd-3fa6f95b3200\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") "
Sep 10 11:29:28.951863 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.951813    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdz4d\" (UniqueName: \"kubernetes.io/projected/3e397343-6297-4506-91bd-3fa6f95b3200-kube-api-access-fdz4d\") pod \"3e397343-6297-4506-91bd-3fa6f95b3200\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") "
Sep 10 11:29:28.951936 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.951892    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e397343-6297-4506-91bd-3fa6f95b3200-openshift-service-ca\") pod \"3e397343-6297-4506-91bd-3fa6f95b3200\" (UID: \"3e397343-6297-4506-91bd-3fa6f95b3200\") "
Sep 10 11:29:28.952313 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.952288    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:28.952570 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.952318    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:28.952570 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.952330    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dl6j\" (UniqueName: \"kubernetes.io/projected/c9bf1df0-8a43-47ab-a638-8ebd97fe7557-kube-api-access-4dl6j\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:28.952570 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.952269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e397343-6297-4506-91bd-3fa6f95b3200-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e397343-6297-4506-91bd-3fa6f95b3200" (UID: "3e397343-6297-4506-91bd-3fa6f95b3200"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:29:28.953887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.953862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e397343-6297-4506-91bd-3fa6f95b3200" (UID: "3e397343-6297-4506-91bd-3fa6f95b3200"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:29:28.953976 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.953900    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3e397343-6297-4506-91bd-3fa6f95b3200" (UID: "3e397343-6297-4506-91bd-3fa6f95b3200"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:29:28.953976 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:28.953908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e397343-6297-4506-91bd-3fa6f95b3200-kube-api-access-fdz4d" (OuterVolumeSpecName: "kube-api-access-fdz4d") pod "3e397343-6297-4506-91bd-3fa6f95b3200" (UID: "3e397343-6297-4506-91bd-3fa6f95b3200"). InnerVolumeSpecName "kube-api-access-fdz4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:29:29.053619 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.053583    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:29.053619 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.053611    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdz4d\" (UniqueName: \"kubernetes.io/projected/3e397343-6297-4506-91bd-3fa6f95b3200-kube-api-access-fdz4d\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:29.053619 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.053621    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e397343-6297-4506-91bd-3fa6f95b3200-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:29.053832 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.053630    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e397343-6297-4506-91bd-3fa6f95b3200-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:29:29.192667 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.192638    2580 generic.go:356] "Generic (PLEG): container finished" podID="3e397343-6297-4506-91bd-3fa6f95b3200" containerID="5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe" exitCode=0
Sep 10 11:29:29.192831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.192683    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"
Sep 10 11:29:29.192831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.192738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" event={"ID":"3e397343-6297-4506-91bd-3fa6f95b3200","Type":"ContainerDied","Data":"5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe"}
Sep 10 11:29:29.192831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.192788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7" event={"ID":"3e397343-6297-4506-91bd-3fa6f95b3200","Type":"ContainerDied","Data":"993313d777a683483f7dd80349a11fd356453a8ad16775af00afc86953cd7ac8"}
Sep 10 11:29:29.192831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.192813    2580 scope.go:117] "RemoveContainer" containerID="5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe"
Sep 10 11:29:29.194175 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.194144    2580 generic.go:356] "Generic (PLEG): container finished" podID="c9bf1df0-8a43-47ab-a638-8ebd97fe7557" containerID="d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543" exitCode=0
Sep 10 11:29:29.194296 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.194179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" event={"ID":"c9bf1df0-8a43-47ab-a638-8ebd97fe7557","Type":"ContainerDied","Data":"d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543"}
Sep 10 11:29:29.194296 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.194190    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"
Sep 10 11:29:29.194296 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.194211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh" event={"ID":"c9bf1df0-8a43-47ab-a638-8ebd97fe7557","Type":"ContainerDied","Data":"b3036f56d7ee11755cc8425d17968a7bb145194bda16ebbcf17860591633a2fa"}
Sep 10 11:29:29.203498 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.203437    2580 scope.go:117] "RemoveContainer" containerID="5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe"
Sep 10 11:29:29.203909 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:29:29.203762    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe\": container with ID starting with 5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe not found: ID does not exist" containerID="5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe"
Sep 10 11:29:29.203909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.203786    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe"} err="failed to get container status \"5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe\": rpc error: code = NotFound desc = could not find container \"5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe\": container with ID starting with 5593c89f178a56b6fd3bb81f2babbf48ef68235a8590d47b5fd76eff7a680ebe not found: ID does not exist"
Sep 10 11:29:29.203909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.203802    2580 scope.go:117] "RemoveContainer" containerID="d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543"
Sep 10 11:29:29.212406 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.212391    2580 scope.go:117] "RemoveContainer" containerID="d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543"
Sep 10 11:29:29.212844 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:29:29.212777    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543\": container with ID starting with d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543 not found: ID does not exist" containerID="d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543"
Sep 10 11:29:29.212844 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.212810    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543"} err="failed to get container status \"d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543\": rpc error: code = NotFound desc = could not find container \"d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543\": container with ID starting with d2cb5fc4ae79ab96c6f1e8ca5a64e6e31818e63ef80220c1c0f7a51fc0f8d543 not found: ID does not exist"
Sep 10 11:29:29.225050 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.225031    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"]
Sep 10 11:29:29.232500 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.232471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0024ffd2-f996d97c4-nbrdh"]
Sep 10 11:29:29.244872 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.244851    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"]
Sep 10 11:29:29.247010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:29.246991    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8de26b-6ccc88d5d7-ljzd7"]
Sep 10 11:29:30.419708 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:30.419675    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e397343-6297-4506-91bd-3fa6f95b3200" path="/var/lib/kubelet/pods/3e397343-6297-4506-91bd-3fa6f95b3200/volumes"
Sep 10 11:29:30.420081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:30.420073    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9bf1df0-8a43-47ab-a638-8ebd97fe7557" path="/var/lib/kubelet/pods/c9bf1df0-8a43-47ab-a638-8ebd97fe7557/volumes"
Sep 10 11:29:42.265601 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.265569    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"]
Sep 10 11:29:42.268205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.265997    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9bf1df0-8a43-47ab-a638-8ebd97fe7557" containerName="maas-api"
Sep 10 11:29:42.268205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.266008    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9bf1df0-8a43-47ab-a638-8ebd97fe7557" containerName="maas-api"
Sep 10 11:29:42.268205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.266019    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e397343-6297-4506-91bd-3fa6f95b3200" containerName="maas-api"
Sep 10 11:29:42.268205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.266024    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e397343-6297-4506-91bd-3fa6f95b3200" containerName="maas-api"
Sep 10 11:29:42.268205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.266086    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9bf1df0-8a43-47ab-a638-8ebd97fe7557" containerName="maas-api"
Sep 10 11:29:42.268205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.266092    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e397343-6297-4506-91bd-3fa6f95b3200" containerName="maas-api"
Sep 10 11:29:42.270043 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.270024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.275476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.275455    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-f39de1-serving-cert\""
Sep 10 11:29:42.289251 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.289226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"]
Sep 10 11:29:42.371572 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.371525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6bkx\" (UniqueName: \"kubernetes.io/projected/edc12328-25a7-4b34-8d9b-387ffc453082-kube-api-access-r6bkx\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.371734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.371590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-metrics-certs\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.371734 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.371635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.371861 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.371826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc12328-25a7-4b34-8d9b-387ffc453082-openshift-service-ca\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.473340 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.473305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc12328-25a7-4b34-8d9b-387ffc453082-openshift-service-ca\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.473501 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.473385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6bkx\" (UniqueName: \"kubernetes.io/projected/edc12328-25a7-4b34-8d9b-387ffc453082-kube-api-access-r6bkx\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.473501 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.473413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-metrics-certs\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.473501 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.473454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.482628 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:29:42.482598    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-serving-cert: secret "maas-api-e2e-explicit-f39de1-serving-cert" not found
Sep 10 11:29:42.482751 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:29:42.482714    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls podName:edc12328-25a7-4b34-8d9b-387ffc453082 nodeName:}" failed. No retries permitted until 2026-09-10 11:29:42.982680614 +0000 UTC m=+907.076882254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls") pod "maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" (UID: "edc12328-25a7-4b34-8d9b-387ffc453082") : secret "maas-api-e2e-explicit-f39de1-serving-cert" not found
Sep 10 11:29:42.483642 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.483619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc12328-25a7-4b34-8d9b-387ffc453082-openshift-service-ca\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.483900 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.483877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-metrics-certs\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:42.498914 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:42.498893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6bkx\" (UniqueName: \"kubernetes.io/projected/edc12328-25a7-4b34-8d9b-387ffc453082-kube-api-access-r6bkx\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:43.078798 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:43.078758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:43.081198 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:43.081173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls\") pod \"maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:43.180268 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:43.180238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:43.467650 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:43.467622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"]
Sep 10 11:29:43.468905 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:29:43.468874    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc12328_25a7_4b34_8d9b_387ffc453082.slice/crio-26ba5997f99985ea61e564f54df29233512c2bef32a6dfe9e2058a5a7049c089 WatchSource:0}: Error finding container 26ba5997f99985ea61e564f54df29233512c2bef32a6dfe9e2058a5a7049c089: Status 404 returned error can't find the container with id 26ba5997f99985ea61e564f54df29233512c2bef32a6dfe9e2058a5a7049c089
Sep 10 11:29:44.285638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:44.285607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" event={"ID":"edc12328-25a7-4b34-8d9b-387ffc453082","Type":"ContainerStarted","Data":"438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6"}
Sep 10 11:29:44.285777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:44.285657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" event={"ID":"edc12328-25a7-4b34-8d9b-387ffc453082","Type":"ContainerStarted","Data":"26ba5997f99985ea61e564f54df29233512c2bef32a6dfe9e2058a5a7049c089"}
Sep 10 11:29:44.285777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:44.285692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:29:44.311740 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:44.311693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" podStartSLOduration=1.691661591 podStartE2EDuration="2.3116782s" totalImagesPullingTime="620.016609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:29:44.308697974 +0000 UTC m=+908.402899629" watchObservedRunningTime="2026-09-10 11:29:44.3116782 +0000 UTC m=+908.405879859"
Sep 10 11:29:50.297344 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:29:50.297315    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:30:38.000592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.000557    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"]
Sep 10 11:30:38.001156 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.000796    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" podUID="edc12328-25a7-4b34-8d9b-387ffc453082" containerName="maas-api" containerID="cri-o://438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6" gracePeriod=30
Sep 10 11:30:38.249771 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.249746    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:30:38.369914 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.369838    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc12328-25a7-4b34-8d9b-387ffc453082-openshift-service-ca\") pod \"edc12328-25a7-4b34-8d9b-387ffc453082\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") "
Sep 10 11:30:38.370077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.369964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-metrics-certs\") pod \"edc12328-25a7-4b34-8d9b-387ffc453082\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") "
Sep 10 11:30:38.370077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.370002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6bkx\" (UniqueName: \"kubernetes.io/projected/edc12328-25a7-4b34-8d9b-387ffc453082-kube-api-access-r6bkx\") pod \"edc12328-25a7-4b34-8d9b-387ffc453082\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") "
Sep 10 11:30:38.370077 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.370063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls\") pod \"edc12328-25a7-4b34-8d9b-387ffc453082\" (UID: \"edc12328-25a7-4b34-8d9b-387ffc453082\") "
Sep 10 11:30:38.370258 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.370223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc12328-25a7-4b34-8d9b-387ffc453082-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edc12328-25a7-4b34-8d9b-387ffc453082" (UID: "edc12328-25a7-4b34-8d9b-387ffc453082"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:30:38.370437 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.370406    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc12328-25a7-4b34-8d9b-387ffc453082-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:30:38.372831 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.372805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "edc12328-25a7-4b34-8d9b-387ffc453082" (UID: "edc12328-25a7-4b34-8d9b-387ffc453082"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:30:38.372924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.372860    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edc12328-25a7-4b34-8d9b-387ffc453082" (UID: "edc12328-25a7-4b34-8d9b-387ffc453082"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:30:38.372924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.372881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc12328-25a7-4b34-8d9b-387ffc453082-kube-api-access-r6bkx" (OuterVolumeSpecName: "kube-api-access-r6bkx") pod "edc12328-25a7-4b34-8d9b-387ffc453082" (UID: "edc12328-25a7-4b34-8d9b-387ffc453082"). InnerVolumeSpecName "kube-api-access-r6bkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:30:38.469910 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:30:38.469882    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc12328_25a7_4b34_8d9b_387ffc453082.slice\": RecentStats: unable to find data in memory cache]"
Sep 10 11:30:38.471421 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.471399    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6bkx\" (UniqueName: \"kubernetes.io/projected/edc12328-25a7-4b34-8d9b-387ffc453082-kube-api-access-r6bkx\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:30:38.471496 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.471426    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:30:38.471496 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.471439    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc12328-25a7-4b34-8d9b-387ffc453082-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:30:38.585794 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.585765    2580 generic.go:356] "Generic (PLEG): container finished" podID="edc12328-25a7-4b34-8d9b-387ffc453082" containerID="438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6" exitCode=0
Sep 10 11:30:38.585909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.585819    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"
Sep 10 11:30:38.585909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.585856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" event={"ID":"edc12328-25a7-4b34-8d9b-387ffc453082","Type":"ContainerDied","Data":"438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6"}
Sep 10 11:30:38.585909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.585903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m" event={"ID":"edc12328-25a7-4b34-8d9b-387ffc453082","Type":"ContainerDied","Data":"26ba5997f99985ea61e564f54df29233512c2bef32a6dfe9e2058a5a7049c089"}
Sep 10 11:30:38.586068 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.585925    2580 scope.go:117] "RemoveContainer" containerID="438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6"
Sep 10 11:30:38.595086 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.595070    2580 scope.go:117] "RemoveContainer" containerID="438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6"
Sep 10 11:30:38.595345 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:30:38.595328    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6\": container with ID starting with 438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6 not found: ID does not exist" containerID="438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6"
Sep 10 11:30:38.595442 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.595353    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6"} err="failed to get container status \"438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6\": rpc error: code = NotFound desc = could not find container \"438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6\": container with ID starting with 438aca6996f259b73430d45a98a1f9ad02abd8e3047e44ff9cdc01b9fe69f8c6 not found: ID does not exist"
Sep 10 11:30:38.607923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.607900    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"]
Sep 10 11:30:38.612549 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:38.612516    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f39de1-74d476cb8f-4hk4m"]
Sep 10 11:30:40.419956 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:30:40.419923    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc12328-25a7-4b34-8d9b-387ffc453082" path="/var/lib/kubelet/pods/edc12328-25a7-4b34-8d9b-387ffc453082/volumes"
Sep 10 11:31:15.778082 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.778051    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"]
Sep 10 11:31:15.778589 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.778478    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc12328-25a7-4b34-8d9b-387ffc453082" containerName="maas-api"
Sep 10 11:31:15.778589 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.778489    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc12328-25a7-4b34-8d9b-387ffc453082" containerName="maas-api"
Sep 10 11:31:15.778589 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.778572    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc12328-25a7-4b34-8d9b-387ffc453082" containerName="maas-api"
Sep 10 11:31:15.781897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.781877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.785027 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.784997    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5cf411f1-serving-cert\""
Sep 10 11:31:15.792469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.792445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-metrics-certs\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.792618 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.792594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.792687 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.792649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kngnv\" (UniqueName: \"kubernetes.io/projected/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-kube-api-access-kngnv\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.792687 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.792678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-openshift-service-ca\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.795389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.795368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"]
Sep 10 11:31:15.893599 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.893567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-metrics-certs\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.893751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.893682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.893751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.893737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kngnv\" (UniqueName: \"kubernetes.io/projected/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-kube-api-access-kngnv\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.893832 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.893765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-openshift-service-ca\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.893871 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:31:15.893823    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-serving-cert: secret "maas-api-e2e-mt-5cf411f1-serving-cert" not found
Sep 10 11:31:15.893912 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:31:15.893904    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls podName:94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d nodeName:}" failed. No retries permitted until 2026-09-10 11:31:16.3938821 +0000 UTC m=+1000.488083739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls") pod "maas-api-e2e-mt-5cf411f1-d58494959-k8h49" (UID: "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d") : secret "maas-api-e2e-mt-5cf411f1-serving-cert" not found
Sep 10 11:31:15.894409 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.894389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-openshift-service-ca\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.896433 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.896403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-metrics-certs\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:15.906444 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:15.906410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kngnv\" (UniqueName: \"kubernetes.io/projected/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-kube-api-access-kngnv\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:16.397416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:16.397376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:16.399993 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:16.399970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls\") pod \"maas-api-e2e-mt-5cf411f1-d58494959-k8h49\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:16.694163 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:16.694079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:16.972576 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:16.972521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"]
Sep 10 11:31:16.975218 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:31:16.975194    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d2938a_f5a0_4c48_b5d3_c5c1bb573b0d.slice/crio-d411d0b535a9ab64aae1579abcaca2f098579691d701c6944fb96c76336a77b8 WatchSource:0}: Error finding container d411d0b535a9ab64aae1579abcaca2f098579691d701c6944fb96c76336a77b8: Status 404 returned error can't find the container with id d411d0b535a9ab64aae1579abcaca2f098579691d701c6944fb96c76336a77b8
Sep 10 11:31:16.977046 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:16.977023    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:31:17.808367 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:17.808339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49" event={"ID":"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d","Type":"ContainerStarted","Data":"04782084264a74116644e68d4c8f33f49a9d2a0b2b2d81dc8424d343e543a891"}
Sep 10 11:31:17.808523 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:17.808401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49" event={"ID":"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d","Type":"ContainerStarted","Data":"d411d0b535a9ab64aae1579abcaca2f098579691d701c6944fb96c76336a77b8"}
Sep 10 11:31:17.808523 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:17.808482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:17.828728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:17.828674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49" podStartSLOduration=2.095666367 podStartE2EDuration="2.828659527s" totalImagesPullingTime="732.99316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:31:17.828122679 +0000 UTC m=+1001.922324363" watchObservedRunningTime="2026-09-10 11:31:17.828659527 +0000 UTC m=+1001.922861188"
Sep 10 11:31:23.821107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:23.821077    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:32.023095 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.023065    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"]
Sep 10 11:31:32.023503 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.023284    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8" podUID="87d80dd9-95f7-45ca-be78-66274c7f5f70" containerName="maas-api" containerID="cri-o://df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4" gracePeriod=30
Sep 10 11:31:32.281612 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.281557    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:31:32.341386 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.341357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-maas-api-tls\") pod \"87d80dd9-95f7-45ca-be78-66274c7f5f70\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") "
Sep 10 11:31:32.341561 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.341490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-metrics-certs\") pod \"87d80dd9-95f7-45ca-be78-66274c7f5f70\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") "
Sep 10 11:31:32.341561 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.341524    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d80dd9-95f7-45ca-be78-66274c7f5f70-openshift-service-ca\") pod \"87d80dd9-95f7-45ca-be78-66274c7f5f70\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") "
Sep 10 11:31:32.341791 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.341570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdpvr\" (UniqueName: \"kubernetes.io/projected/87d80dd9-95f7-45ca-be78-66274c7f5f70-kube-api-access-kdpvr\") pod \"87d80dd9-95f7-45ca-be78-66274c7f5f70\" (UID: \"87d80dd9-95f7-45ca-be78-66274c7f5f70\") "
Sep 10 11:31:32.342410 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.342373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d80dd9-95f7-45ca-be78-66274c7f5f70-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87d80dd9-95f7-45ca-be78-66274c7f5f70" (UID: "87d80dd9-95f7-45ca-be78-66274c7f5f70"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:31:32.343830 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.343807    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87d80dd9-95f7-45ca-be78-66274c7f5f70" (UID: "87d80dd9-95f7-45ca-be78-66274c7f5f70"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:31:32.344194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.344177    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "87d80dd9-95f7-45ca-be78-66274c7f5f70" (UID: "87d80dd9-95f7-45ca-be78-66274c7f5f70"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:31:32.344260 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.344196    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d80dd9-95f7-45ca-be78-66274c7f5f70-kube-api-access-kdpvr" (OuterVolumeSpecName: "kube-api-access-kdpvr") pod "87d80dd9-95f7-45ca-be78-66274c7f5f70" (UID: "87d80dd9-95f7-45ca-be78-66274c7f5f70"). InnerVolumeSpecName "kube-api-access-kdpvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:31:32.442926 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.442902    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:32.442926 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.442925    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d80dd9-95f7-45ca-be78-66274c7f5f70-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:32.443075 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.442935    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdpvr\" (UniqueName: \"kubernetes.io/projected/87d80dd9-95f7-45ca-be78-66274c7f5f70-kube-api-access-kdpvr\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:32.443075 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.442944    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d80dd9-95f7-45ca-be78-66274c7f5f70-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:32.894878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.894843    2580 generic.go:356] "Generic (PLEG): container finished" podID="87d80dd9-95f7-45ca-be78-66274c7f5f70" containerID="df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4" exitCode=0
Sep 10 11:31:32.895079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.894885    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"
Sep 10 11:31:32.895079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.894926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8" event={"ID":"87d80dd9-95f7-45ca-be78-66274c7f5f70","Type":"ContainerDied","Data":"df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4"}
Sep 10 11:31:32.895079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.894993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8" event={"ID":"87d80dd9-95f7-45ca-be78-66274c7f5f70","Type":"ContainerDied","Data":"1f366a8a021041215cbc0564bf5bd25c3e840225ed87e711a1fcc82098f9e48a"}
Sep 10 11:31:32.895079 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.895025    2580 scope.go:117] "RemoveContainer" containerID="df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4"
Sep 10 11:31:32.906098 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.906074    2580 scope.go:117] "RemoveContainer" containerID="df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4"
Sep 10 11:31:32.906690 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:31:32.906666    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4\": container with ID starting with df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4 not found: ID does not exist" containerID="df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4"
Sep 10 11:31:32.906824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.906696    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4"} err="failed to get container status \"df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4\": rpc error: code = NotFound desc = could not find container \"df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4\": container with ID starting with df4c4f223619f70962ba335eeddb912d7e2b01a9c790c47741df0d36ac27ecd4 not found: ID does not exist"
Sep 10 11:31:32.922132 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.922109    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"]
Sep 10 11:31:32.935345 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:32.935325    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8355df-5d44667c4c-bj8n8"]
Sep 10 11:31:34.419655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:34.419620    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d80dd9-95f7-45ca-be78-66274c7f5f70" path="/var/lib/kubelet/pods/87d80dd9-95f7-45ca-be78-66274c7f5f70/volumes"
Sep 10 11:31:50.686296 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.686264    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"]
Sep 10 11:31:50.686749 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.686461    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l" podUID="820ede9c-877d-4962-8f8b-5003b75b6929" containerName="maas-api" containerID="cri-o://3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809" gracePeriod=30
Sep 10 11:31:50.937178 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.937123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:31:50.996240 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.996213    2580 generic.go:356] "Generic (PLEG): container finished" podID="820ede9c-877d-4962-8f8b-5003b75b6929" containerID="3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809" exitCode=0
Sep 10 11:31:50.996394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.996258    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"
Sep 10 11:31:50.996394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.996304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l" event={"ID":"820ede9c-877d-4962-8f8b-5003b75b6929","Type":"ContainerDied","Data":"3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809"}
Sep 10 11:31:50.996394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.996360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l" event={"ID":"820ede9c-877d-4962-8f8b-5003b75b6929","Type":"ContainerDied","Data":"c56b8138e18706abbc8e871ead1da61ebe6a07ed2a65c13e1d384b3dbc894a1d"}
Sep 10 11:31:50.996394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:50.996387    2580 scope.go:117] "RemoveContainer" containerID="3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809"
Sep 10 11:31:51.005429 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.005411    2580 scope.go:117] "RemoveContainer" containerID="3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809"
Sep 10 11:31:51.005711 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:31:51.005690    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809\": container with ID starting with 3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809 not found: ID does not exist" containerID="3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809"
Sep 10 11:31:51.005803 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.005718    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809"} err="failed to get container status \"3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809\": rpc error: code = NotFound desc = could not find container \"3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809\": container with ID starting with 3f5fa27ba8ed3c5a41b2fa873de1dc1e024219a1f50a9b497d76a2f066200809 not found: ID does not exist"
Sep 10 11:31:51.118054 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.118032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820ede9c-877d-4962-8f8b-5003b75b6929-openshift-service-ca\") pod \"820ede9c-877d-4962-8f8b-5003b75b6929\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") "
Sep 10 11:31:51.118202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.118069    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-metrics-certs\") pod \"820ede9c-877d-4962-8f8b-5003b75b6929\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") "
Sep 10 11:31:51.118202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.118136    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf8d9\" (UniqueName: \"kubernetes.io/projected/820ede9c-877d-4962-8f8b-5003b75b6929-kube-api-access-xf8d9\") pod \"820ede9c-877d-4962-8f8b-5003b75b6929\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") "
Sep 10 11:31:51.118202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.118162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-maas-api-tls\") pod \"820ede9c-877d-4962-8f8b-5003b75b6929\" (UID: \"820ede9c-877d-4962-8f8b-5003b75b6929\") "
Sep 10 11:31:51.118474 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.118444    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820ede9c-877d-4962-8f8b-5003b75b6929-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "820ede9c-877d-4962-8f8b-5003b75b6929" (UID: "820ede9c-877d-4962-8f8b-5003b75b6929"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:31:51.120474 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.120443    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "820ede9c-877d-4962-8f8b-5003b75b6929" (UID: "820ede9c-877d-4962-8f8b-5003b75b6929"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:31:51.120600 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.120507    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "820ede9c-877d-4962-8f8b-5003b75b6929" (UID: "820ede9c-877d-4962-8f8b-5003b75b6929"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:31:51.120600 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.120519    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820ede9c-877d-4962-8f8b-5003b75b6929-kube-api-access-xf8d9" (OuterVolumeSpecName: "kube-api-access-xf8d9") pod "820ede9c-877d-4962-8f8b-5003b75b6929" (UID: "820ede9c-877d-4962-8f8b-5003b75b6929"). InnerVolumeSpecName "kube-api-access-xf8d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:31:51.219698 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.219676    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820ede9c-877d-4962-8f8b-5003b75b6929-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:51.219698 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.219697    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:51.219825 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.219706    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf8d9\" (UniqueName: \"kubernetes.io/projected/820ede9c-877d-4962-8f8b-5003b75b6929-kube-api-access-xf8d9\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:51.219825 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.219714    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820ede9c-877d-4962-8f8b-5003b75b6929-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:51.321597 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.321570    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"]
Sep 10 11:31:51.326384 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:51.326364    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c9990-fc948b647-v8h7l"]
Sep 10 11:31:52.419416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:52.419380    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820ede9c-877d-4962-8f8b-5003b75b6929" path="/var/lib/kubelet/pods/820ede9c-877d-4962-8f8b-5003b75b6929/volumes"
Sep 10 11:31:57.920487 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:57.920450    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"]
Sep 10 11:31:57.921071 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:57.920701    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49" podUID="94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" containerName="maas-api" containerID="cri-o://04782084264a74116644e68d4c8f33f49a9d2a0b2b2d81dc8424d343e543a891" gracePeriod=30
Sep 10 11:31:58.045051 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.045018    2580 generic.go:356] "Generic (PLEG): container finished" podID="94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" containerID="04782084264a74116644e68d4c8f33f49a9d2a0b2b2d81dc8424d343e543a891" exitCode=0
Sep 10 11:31:58.045051 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.045042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49" event={"ID":"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d","Type":"ContainerDied","Data":"04782084264a74116644e68d4c8f33f49a9d2a0b2b2d81dc8424d343e543a891"}
Sep 10 11:31:58.179728 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.179675    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:58.278258 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.278233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kngnv\" (UniqueName: \"kubernetes.io/projected/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-kube-api-access-kngnv\") pod \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") "
Sep 10 11:31:58.278439 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.278340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls\") pod \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") "
Sep 10 11:31:58.278439 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.278410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-openshift-service-ca\") pod \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") "
Sep 10 11:31:58.278604 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.278440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-metrics-certs\") pod \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\" (UID: \"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d\") "
Sep 10 11:31:58.278825 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.278798    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" (UID: "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:31:58.280638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.280609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" (UID: "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:31:58.280638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.280622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-kube-api-access-kngnv" (OuterVolumeSpecName: "kube-api-access-kngnv") pod "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" (UID: "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d"). InnerVolumeSpecName "kube-api-access-kngnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:31:58.280800 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.280644    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" (UID: "94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:31:58.379653 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.379624    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:58.379653 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.379646    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:58.379653 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.379655    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:58.379863 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:58.379663    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kngnv\" (UniqueName: \"kubernetes.io/projected/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d-kube-api-access-kngnv\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:31:59.053062 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:59.053026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49" event={"ID":"94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d","Type":"ContainerDied","Data":"d411d0b535a9ab64aae1579abcaca2f098579691d701c6944fb96c76336a77b8"}
Sep 10 11:31:59.053469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:59.053063    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"
Sep 10 11:31:59.053469 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:59.053098    2580 scope.go:117] "RemoveContainer" containerID="04782084264a74116644e68d4c8f33f49a9d2a0b2b2d81dc8424d343e543a891"
Sep 10 11:31:59.080181 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:59.080158    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"]
Sep 10 11:31:59.082714 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:31:59.082692    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cf411f1-d58494959-k8h49"]
Sep 10 11:32:00.420547 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:00.420497    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" path="/var/lib/kubelet/pods/94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d/volumes"
Sep 10 11:32:04.958589 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.958557    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"]
Sep 10 11:32:04.959182 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959161    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" containerName="maas-api"
Sep 10 11:32:04.959279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959185    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" containerName="maas-api"
Sep 10 11:32:04.959279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959202    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d80dd9-95f7-45ca-be78-66274c7f5f70" containerName="maas-api"
Sep 10 11:32:04.959279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959210    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d80dd9-95f7-45ca-be78-66274c7f5f70" containerName="maas-api"
Sep 10 11:32:04.959279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959220    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820ede9c-877d-4962-8f8b-5003b75b6929" containerName="maas-api"
Sep 10 11:32:04.959279 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959228    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="820ede9c-877d-4962-8f8b-5003b75b6929" containerName="maas-api"
Sep 10 11:32:04.959522 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959352    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d80dd9-95f7-45ca-be78-66274c7f5f70" containerName="maas-api"
Sep 10 11:32:04.959522 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959362    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d2938a-f5a0-4c48-b5d3-c5c1bb573b0d" containerName="maas-api"
Sep 10 11:32:04.959522 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.959373    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="820ede9c-877d-4962-8f8b-5003b75b6929" containerName="maas-api"
Sep 10 11:32:04.962867 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.962845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:04.965651 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.965630    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-5fde2a-serving-cert\""
Sep 10 11:32:04.981466 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:04.981442    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"]
Sep 10 11:32:05.032771 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.032745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2c7\" (UniqueName: \"kubernetes.io/projected/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-kube-api-access-fs2c7\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.032912 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.032825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.032912 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.032860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.033018 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.032918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.133660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.133513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.133660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.133589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.133660 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.133648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.133967 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:32:05.133731    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-serving-cert: secret "maas-api-e2e-shared-a-w3-5fde2a-serving-cert" not found
Sep 10 11:32:05.133967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.133769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2c7\" (UniqueName: \"kubernetes.io/projected/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-kube-api-access-fs2c7\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.133967 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:32:05.133801    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls podName:681d1a4f-fbb5-417b-bb15-bde1f3913bfc nodeName:}" failed. No retries permitted until 2026-09-10 11:32:05.633780652 +0000 UTC m=+1049.727982312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls") pod "maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" (UID: "681d1a4f-fbb5-417b-bb15-bde1f3913bfc") : secret "maas-api-e2e-shared-a-w3-5fde2a-serving-cert" not found
Sep 10 11:32:05.134355 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.134330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.136104 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.136085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.144849 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.144825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2c7\" (UniqueName: \"kubernetes.io/projected/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-kube-api-access-fs2c7\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.638743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.638709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.641288 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.641261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:05.874256 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:05.874219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:06.161635 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:06.161604    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"]
Sep 10 11:32:06.162984 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:32:06.162951    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681d1a4f_fbb5_417b_bb15_bde1f3913bfc.slice/crio-8a5629752705108e680dfbcbc5a6fbdc8693e5c62c92539ded253aa1e919e53d WatchSource:0}: Error finding container 8a5629752705108e680dfbcbc5a6fbdc8693e5c62c92539ded253aa1e919e53d: Status 404 returned error can't find the container with id 8a5629752705108e680dfbcbc5a6fbdc8693e5c62c92539ded253aa1e919e53d
Sep 10 11:32:07.102116 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:07.102081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" event={"ID":"681d1a4f-fbb5-417b-bb15-bde1f3913bfc","Type":"ContainerStarted","Data":"bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2"}
Sep 10 11:32:07.102284 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:07.102133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" event={"ID":"681d1a4f-fbb5-417b-bb15-bde1f3913bfc","Type":"ContainerStarted","Data":"8a5629752705108e680dfbcbc5a6fbdc8693e5c62c92539ded253aa1e919e53d"}
Sep 10 11:32:07.102284 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:07.102176    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:07.140219 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:07.140171    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" podStartSLOduration=2.83816301 podStartE2EDuration="3.140155016s" totalImagesPullingTime="301.992006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:32:07.137747716 +0000 UTC m=+1051.231949378" watchObservedRunningTime="2026-09-10 11:32:07.140155016 +0000 UTC m=+1051.234356675"
Sep 10 11:32:13.114436 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:13.114403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:32:26.032946 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.032907    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"]
Sep 10 11:32:26.038327 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.038304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.041092 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.041066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-c2e44c-serving-cert\""
Sep 10 11:32:26.048023 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.048002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"]
Sep 10 11:32:26.122215 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.122188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.122347 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.122262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzhd\" (UniqueName: \"kubernetes.io/projected/40840aa2-581c-4533-a26b-e0133f4b2639-kube-api-access-jxzhd\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.122347 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.122335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.122425 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.122368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40840aa2-581c-4533-a26b-e0133f4b2639-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.223543 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.223513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.223676 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.223647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzhd\" (UniqueName: \"kubernetes.io/projected/40840aa2-581c-4533-a26b-e0133f4b2639-kube-api-access-jxzhd\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.223743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.223709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.223783 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.223739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40840aa2-581c-4533-a26b-e0133f4b2639-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.223888 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:32:26.223868    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-serving-cert: secret "maas-api-e2e-shared-a-w2-c2e44c-serving-cert" not found
Sep 10 11:32:26.223963 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:32:26.223945    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls podName:40840aa2-581c-4533-a26b-e0133f4b2639 nodeName:}" failed. No retries permitted until 2026-09-10 11:32:26.723925462 +0000 UTC m=+1070.818127101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls") pod "maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" (UID: "40840aa2-581c-4533-a26b-e0133f4b2639") : secret "maas-api-e2e-shared-a-w2-c2e44c-serving-cert" not found
Sep 10 11:32:26.224408 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.224344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40840aa2-581c-4533-a26b-e0133f4b2639-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.226132 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.226111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.233291 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.233266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzhd\" (UniqueName: \"kubernetes.io/projected/40840aa2-581c-4533-a26b-e0133f4b2639-kube-api-access-jxzhd\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.729175 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.729139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.731880 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.731853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:26.952623 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:26.952588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:27.243625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:27.243595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"]
Sep 10 11:32:27.245396 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:32:27.245370    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40840aa2_581c_4533_a26b_e0133f4b2639.slice/crio-af0ba50458326b6701492984870d17da99ccef4a483af5a9f0434c98a3a267ea WatchSource:0}: Error finding container af0ba50458326b6701492984870d17da99ccef4a483af5a9f0434c98a3a267ea: Status 404 returned error can't find the container with id af0ba50458326b6701492984870d17da99ccef4a483af5a9f0434c98a3a267ea
Sep 10 11:32:28.224095 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:28.224061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" event={"ID":"40840aa2-581c-4533-a26b-e0133f4b2639","Type":"ContainerStarted","Data":"5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65"}
Sep 10 11:32:28.224253 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:28.224128    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:28.224253 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:28.224147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" event={"ID":"40840aa2-581c-4533-a26b-e0133f4b2639","Type":"ContainerStarted","Data":"af0ba50458326b6701492984870d17da99ccef4a483af5a9f0434c98a3a267ea"}
Sep 10 11:32:28.246111 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:28.246070    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" podStartSLOduration=1.85049551 podStartE2EDuration="2.246054788s" totalImagesPullingTime="395.559278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:32:28.243220832 +0000 UTC m=+1072.337422496" watchObservedRunningTime="2026-09-10 11:32:28.246054788 +0000 UTC m=+1072.340256482"
Sep 10 11:32:33.957214 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:33.957158    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"]
Sep 10 11:32:33.960752 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:33.960730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:33.968778 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:33.968356    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-13c392-serving-cert\""
Sep 10 11:32:33.978926 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:33.978904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"]
Sep 10 11:32:34.102139 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.102086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.102313 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.102173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1bca54-2023-43ce-a608-2523ce5577e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.102313 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.102295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.102398 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.102342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxrg7\" (UniqueName: \"kubernetes.io/projected/8c1bca54-2023-43ce-a608-2523ce5577e7-kube-api-access-zxrg7\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.203431 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.203401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.203630 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.203449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1bca54-2023-43ce-a608-2523ce5577e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.203630 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.203509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.203630 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.203567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxrg7\" (UniqueName: \"kubernetes.io/projected/8c1bca54-2023-43ce-a608-2523ce5577e7-kube-api-access-zxrg7\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.204204 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.204179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1bca54-2023-43ce-a608-2523ce5577e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.206275 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.206245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.206396 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.206283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.212213 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.212156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxrg7\" (UniqueName: \"kubernetes.io/projected/8c1bca54-2023-43ce-a608-2523ce5577e7-kube-api-access-zxrg7\") pod \"maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.235797 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.235773    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:32:34.272092 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.272067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:34.554892 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:34.554858    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"]
Sep 10 11:32:34.555942 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:32:34.555913    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1bca54_2023_43ce_a608_2523ce5577e7.slice/crio-b1208e668995b4caa6e327edff4642319ce93b68dcd1a98f0d64f5c3707fae3c WatchSource:0}: Error finding container b1208e668995b4caa6e327edff4642319ce93b68dcd1a98f0d64f5c3707fae3c: Status 404 returned error can't find the container with id b1208e668995b4caa6e327edff4642319ce93b68dcd1a98f0d64f5c3707fae3c
Sep 10 11:32:35.263788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:35.263704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5" event={"ID":"8c1bca54-2023-43ce-a608-2523ce5577e7","Type":"ContainerStarted","Data":"3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665"}
Sep 10 11:32:35.263788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:35.263758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5" event={"ID":"8c1bca54-2023-43ce-a608-2523ce5577e7","Type":"ContainerStarted","Data":"b1208e668995b4caa6e327edff4642319ce93b68dcd1a98f0d64f5c3707fae3c"}
Sep 10 11:32:35.264196 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:35.263888    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:35.285978 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:35.285930    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5" podStartSLOduration=1.84552974 podStartE2EDuration="2.285916354s" totalImagesPullingTime="440.386614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:32:35.284215657 +0000 UTC m=+1079.378417328" watchObservedRunningTime="2026-09-10 11:32:35.285916354 +0000 UTC m=+1079.380118013"
Sep 10 11:32:41.274201 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:41.274172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:32:55.772594 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.772560    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"]
Sep 10 11:32:55.777317 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.777296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:55.780580 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.780561    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-282355-serving-cert\""
Sep 10 11:32:55.789749 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.789726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"]
Sep 10 11:32:55.900592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.900526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:55.900757 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.900652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppc47\" (UniqueName: \"kubernetes.io/projected/ba94190a-a641-48ac-9e43-f60fb0fa03c0-kube-api-access-ppc47\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:55.900757 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.900692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba94190a-a641-48ac-9e43-f60fb0fa03c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:55.900852 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:55.900823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.002084 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.002047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.002244 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.002096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppc47\" (UniqueName: \"kubernetes.io/projected/ba94190a-a641-48ac-9e43-f60fb0fa03c0-kube-api-access-ppc47\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.002244 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.002165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba94190a-a641-48ac-9e43-f60fb0fa03c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.002377 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.002295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.002438 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:32:56.002397    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-serving-cert: secret "maas-api-e2e-shared-b-w2-282355-serving-cert" not found
Sep 10 11:32:56.002482 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:32:56.002474    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls podName:ba94190a-a641-48ac-9e43-f60fb0fa03c0 nodeName:}" failed. No retries permitted until 2026-09-10 11:32:56.502454636 +0000 UTC m=+1100.596656292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls") pod "maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" (UID: "ba94190a-a641-48ac-9e43-f60fb0fa03c0") : secret "maas-api-e2e-shared-b-w2-282355-serving-cert" not found
Sep 10 11:32:56.002764 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.002744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba94190a-a641-48ac-9e43-f60fb0fa03c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.004931 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.004908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.012878 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.012848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppc47\" (UniqueName: \"kubernetes.io/projected/ba94190a-a641-48ac-9e43-f60fb0fa03c0-kube-api-access-ppc47\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.506154 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.506120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.508780 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.508757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.690641 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.690605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:56.976647 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:56.976623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"]
Sep 10 11:32:56.978091 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:32:56.978062    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba94190a_a641_48ac_9e43_f60fb0fa03c0.slice/crio-0b5c9246e803e1f98e02f30bc4d3eec54cc1f136890c4c37617a985efe6d8cae WatchSource:0}: Error finding container 0b5c9246e803e1f98e02f30bc4d3eec54cc1f136890c4c37617a985efe6d8cae: Status 404 returned error can't find the container with id 0b5c9246e803e1f98e02f30bc4d3eec54cc1f136890c4c37617a985efe6d8cae
Sep 10 11:32:57.396150 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:57.396118    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" event={"ID":"ba94190a-a641-48ac-9e43-f60fb0fa03c0","Type":"ContainerStarted","Data":"0b5c9246e803e1f98e02f30bc4d3eec54cc1f136890c4c37617a985efe6d8cae"}
Sep 10 11:32:58.403450 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:58.403412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" event={"ID":"ba94190a-a641-48ac-9e43-f60fb0fa03c0","Type":"ContainerStarted","Data":"34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd"}
Sep 10 11:32:58.403940 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:58.403547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:32:58.423436 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:32:58.423395    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" podStartSLOduration=3.064365133 podStartE2EDuration="3.423381636s" totalImagesPullingTime="359.016503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:32:58.422283569 +0000 UTC m=+1102.516485230" watchObservedRunningTime="2026-09-10 11:32:58.423381636 +0000 UTC m=+1102.517583296"
Sep 10 11:33:04.420864 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:04.420838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:33:37.346768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.346737    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"]
Sep 10 11:33:37.351104 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.351069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.353944 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.353916    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-52dd3973-serving-cert\""
Sep 10 11:33:37.358777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.358301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.358777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.358358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgk5l\" (UniqueName: \"kubernetes.io/projected/83a2ca07-ddbd-462a-b213-6021744349f5-kube-api-access-rgk5l\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.358777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.358410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a2ca07-ddbd-462a-b213-6021744349f5-openshift-service-ca\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.358777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.358464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-metrics-certs\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.363983 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.363960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"]
Sep 10 11:33:37.459956 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.459921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a2ca07-ddbd-462a-b213-6021744349f5-openshift-service-ca\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.460133 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.459990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-metrics-certs\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.460133 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.460095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.460270 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.460150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgk5l\" (UniqueName: \"kubernetes.io/projected/83a2ca07-ddbd-462a-b213-6021744349f5-kube-api-access-rgk5l\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.460788 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:33:37.460728    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-serving-cert: secret "maas-api-e2e-mt-52dd3973-serving-cert" not found
Sep 10 11:33:37.460788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.460775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a2ca07-ddbd-462a-b213-6021744349f5-openshift-service-ca\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.460965 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:33:37.460841    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls podName:83a2ca07-ddbd-462a-b213-6021744349f5 nodeName:}" failed. No retries permitted until 2026-09-10 11:33:37.96081951 +0000 UTC m=+1142.055021170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls") pod "maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" (UID: "83a2ca07-ddbd-462a-b213-6021744349f5") : secret "maas-api-e2e-mt-52dd3973-serving-cert" not found
Sep 10 11:33:37.463664 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.463641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-metrics-certs\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.469638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.469613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgk5l\" (UniqueName: \"kubernetes.io/projected/83a2ca07-ddbd-462a-b213-6021744349f5-kube-api-access-rgk5l\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.964341 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.964308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:37.966776 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:37.966748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls\") pod \"maas-api-e2e-mt-52dd3973-d887c9c9-bpklm\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:38.265192 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:38.265120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:38.553128 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:38.553098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"]
Sep 10 11:33:38.557697 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:33:38.557657    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a2ca07_ddbd_462a_b213_6021744349f5.slice/crio-bb77c818fc99b427c7a7945341ce21ab75d069195627d66dbb4593ed2a7ae3cf WatchSource:0}: Error finding container bb77c818fc99b427c7a7945341ce21ab75d069195627d66dbb4593ed2a7ae3cf: Status 404 returned error can't find the container with id bb77c818fc99b427c7a7945341ce21ab75d069195627d66dbb4593ed2a7ae3cf
Sep 10 11:33:38.625370 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:38.625341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" event={"ID":"83a2ca07-ddbd-462a-b213-6021744349f5","Type":"ContainerStarted","Data":"bb77c818fc99b427c7a7945341ce21ab75d069195627d66dbb4593ed2a7ae3cf"}
Sep 10 11:33:39.633004 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:39.632965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" event={"ID":"83a2ca07-ddbd-462a-b213-6021744349f5","Type":"ContainerStarted","Data":"fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a"}
Sep 10 11:33:39.633418 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:39.633173    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:33:39.658764 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:39.658719    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" podStartSLOduration=2.278760942 podStartE2EDuration="2.658704246s" totalImagesPullingTime="379.943304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:33:39.655306589 +0000 UTC m=+1143.749508249" watchObservedRunningTime="2026-09-10 11:33:39.658704246 +0000 UTC m=+1143.752905906"
Sep 10 11:33:45.644061 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:33:45.644027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:35:06.824109 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:06.824078    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"]
Sep 10 11:35:06.825802 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:06.824312    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" podUID="83a2ca07-ddbd-462a-b213-6021744349f5" containerName="maas-api" containerID="cri-o://fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a" gracePeriod=30
Sep 10 11:35:07.080230 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.080170    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:35:07.129711 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.129681    2580 generic.go:356] "Generic (PLEG): container finished" podID="83a2ca07-ddbd-462a-b213-6021744349f5" containerID="fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a" exitCode=0
Sep 10 11:35:07.129859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.129736    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"
Sep 10 11:35:07.129859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.129770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" event={"ID":"83a2ca07-ddbd-462a-b213-6021744349f5","Type":"ContainerDied","Data":"fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a"}
Sep 10 11:35:07.129859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.129821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm" event={"ID":"83a2ca07-ddbd-462a-b213-6021744349f5","Type":"ContainerDied","Data":"bb77c818fc99b427c7a7945341ce21ab75d069195627d66dbb4593ed2a7ae3cf"}
Sep 10 11:35:07.129859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.129850    2580 scope.go:117] "RemoveContainer" containerID="fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a"
Sep 10 11:35:07.138910 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.138893    2580 scope.go:117] "RemoveContainer" containerID="fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a"
Sep 10 11:35:07.139179 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:35:07.139153    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a\": container with ID starting with fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a not found: ID does not exist" containerID="fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a"
Sep 10 11:35:07.139239 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.139191    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a"} err="failed to get container status \"fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a\": rpc error: code = NotFound desc = could not find container \"fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a\": container with ID starting with fc41149e2a233ec2330ccb30b95e38bbb08f95251553bd7cf576fdd457d2a38a not found: ID does not exist"
Sep 10 11:35:07.247318 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.247293    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgk5l\" (UniqueName: \"kubernetes.io/projected/83a2ca07-ddbd-462a-b213-6021744349f5-kube-api-access-rgk5l\") pod \"83a2ca07-ddbd-462a-b213-6021744349f5\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") "
Sep 10 11:35:07.247471 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.247356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a2ca07-ddbd-462a-b213-6021744349f5-openshift-service-ca\") pod \"83a2ca07-ddbd-462a-b213-6021744349f5\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") "
Sep 10 11:35:07.247471 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.247433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls\") pod \"83a2ca07-ddbd-462a-b213-6021744349f5\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") "
Sep 10 11:35:07.247594 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.247570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-metrics-certs\") pod \"83a2ca07-ddbd-462a-b213-6021744349f5\" (UID: \"83a2ca07-ddbd-462a-b213-6021744349f5\") "
Sep 10 11:35:07.247745 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.247724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83a2ca07-ddbd-462a-b213-6021744349f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83a2ca07-ddbd-462a-b213-6021744349f5" (UID: "83a2ca07-ddbd-462a-b213-6021744349f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:35:07.247971 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.247948    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a2ca07-ddbd-462a-b213-6021744349f5-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:35:07.249832 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.249805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a2ca07-ddbd-462a-b213-6021744349f5-kube-api-access-rgk5l" (OuterVolumeSpecName: "kube-api-access-rgk5l") pod "83a2ca07-ddbd-462a-b213-6021744349f5" (UID: "83a2ca07-ddbd-462a-b213-6021744349f5"). InnerVolumeSpecName "kube-api-access-rgk5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:35:07.249959 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.249813    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83a2ca07-ddbd-462a-b213-6021744349f5" (UID: "83a2ca07-ddbd-462a-b213-6021744349f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:35:07.250256 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.250231    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "83a2ca07-ddbd-462a-b213-6021744349f5" (UID: "83a2ca07-ddbd-462a-b213-6021744349f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:35:07.349263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.349207    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:35:07.349263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.349231    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgk5l\" (UniqueName: \"kubernetes.io/projected/83a2ca07-ddbd-462a-b213-6021744349f5-kube-api-access-rgk5l\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:35:07.349263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.349240    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a2ca07-ddbd-462a-b213-6021744349f5-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:35:07.460122 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.460094    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"]
Sep 10 11:35:07.468974 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:07.468954    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52dd3973-d887c9c9-bpklm"]
Sep 10 11:35:08.419705 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:35:08.419676    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a2ca07-ddbd-462a-b213-6021744349f5" path="/var/lib/kubelet/pods/83a2ca07-ddbd-462a-b213-6021744349f5/volumes"
Sep 10 11:37:00.671199 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.671093    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"]
Sep 10 11:37:00.672271 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.672242    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a2ca07-ddbd-462a-b213-6021744349f5" containerName="maas-api"
Sep 10 11:37:00.672271 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.672271    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a2ca07-ddbd-462a-b213-6021744349f5" containerName="maas-api"
Sep 10 11:37:00.672486 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.672387    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a2ca07-ddbd-462a-b213-6021744349f5" containerName="maas-api"
Sep 10 11:37:00.676140 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.676113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.679339 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.679316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e89227-serving-cert\""
Sep 10 11:37:00.687798 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.687768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"]
Sep 10 11:37:00.753243 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.753216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.753407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.753255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-metrics-certs\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.753407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.753286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w22ls\" (UniqueName: \"kubernetes.io/projected/1a87b302-a371-480c-a9a2-8e345edbd6ae-kube-api-access-w22ls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.753407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.753353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a87b302-a371-480c-a9a2-8e345edbd6ae-openshift-service-ca\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.854389 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.854362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.854579 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.854400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-metrics-certs\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.854579 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.854426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w22ls\" (UniqueName: \"kubernetes.io/projected/1a87b302-a371-480c-a9a2-8e345edbd6ae-kube-api-access-w22ls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.854579 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.854476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a87b302-a371-480c-a9a2-8e345edbd6ae-openshift-service-ca\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.854579 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:37:00.854559    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-serving-cert: secret "maas-api-e2e-api-a-e89227-serving-cert" not found
Sep 10 11:37:00.854749 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:37:00.854625    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls podName:1a87b302-a371-480c-a9a2-8e345edbd6ae nodeName:}" failed. No retries permitted until 2026-09-10 11:37:01.354608985 +0000 UTC m=+1345.448810623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls") pod "maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" (UID: "1a87b302-a371-480c-a9a2-8e345edbd6ae") : secret "maas-api-e2e-api-a-e89227-serving-cert" not found
Sep 10 11:37:00.855234 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.855166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a87b302-a371-480c-a9a2-8e345edbd6ae-openshift-service-ca\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.857055 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.857028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-metrics-certs\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:00.866584 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:00.866561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w22ls\" (UniqueName: \"kubernetes.io/projected/1a87b302-a371-480c-a9a2-8e345edbd6ae-kube-api-access-w22ls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:01.359129 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:01.359094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:01.361501 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:01.361477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls\") pod \"maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:01.587699 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:01.587666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:01.868305 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:37:01.868274    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a87b302_a371_480c_a9a2_8e345edbd6ae.slice/crio-b5c49c7e2c50246bb26c1e27aa40a8608ed352a24e514f06df942397c2ddfd7f WatchSource:0}: Error finding container b5c49c7e2c50246bb26c1e27aa40a8608ed352a24e514f06df942397c2ddfd7f: Status 404 returned error can't find the container with id b5c49c7e2c50246bb26c1e27aa40a8608ed352a24e514f06df942397c2ddfd7f
Sep 10 11:37:01.868640 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:01.868589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"]
Sep 10 11:37:01.869549 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:01.869514    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:37:02.802480 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:02.802442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" event={"ID":"1a87b302-a371-480c-a9a2-8e345edbd6ae","Type":"ContainerStarted","Data":"0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760"}
Sep 10 11:37:02.802649 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:02.802493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" event={"ID":"1a87b302-a371-480c-a9a2-8e345edbd6ae","Type":"ContainerStarted","Data":"b5c49c7e2c50246bb26c1e27aa40a8608ed352a24e514f06df942397c2ddfd7f"}
Sep 10 11:37:02.802711 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:02.802644    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:02.831022 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:02.830979    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" podStartSLOduration=2.276005604 podStartE2EDuration="2.830966999s" totalImagesPullingTime="554.961395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:37:02.83069742 +0000 UTC m=+1346.924899082" watchObservedRunningTime="2026-09-10 11:37:02.830966999 +0000 UTC m=+1346.925168658"
Sep 10 11:37:08.814129 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:08.814098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:37:29.725751 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.725717    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"]
Sep 10 11:37:29.730261 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.730239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:29.733785 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.733761    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-7a970e-serving-cert\""
Sep 10 11:37:29.743349 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.743322    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"]
Sep 10 11:37:29.915221 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.915189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6720a3a7-8da7-4737-8099-4478d0b8c564-openshift-service-ca\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:29.915393 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.915252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8fqg\" (UniqueName: \"kubernetes.io/projected/6720a3a7-8da7-4737-8099-4478d0b8c564-kube-api-access-r8fqg\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:29.915393 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.915320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-metrics-certs\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:29.915393 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:29.915368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-maas-api-tls\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.016839 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.016759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-maas-api-tls\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.016839 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.016815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6720a3a7-8da7-4737-8099-4478d0b8c564-openshift-service-ca\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.017002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.016864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8fqg\" (UniqueName: \"kubernetes.io/projected/6720a3a7-8da7-4737-8099-4478d0b8c564-kube-api-access-r8fqg\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.017002 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.016892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-metrics-certs\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.017590 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.017510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6720a3a7-8da7-4737-8099-4478d0b8c564-openshift-service-ca\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.019300 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.019240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-maas-api-tls\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.019584 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.019400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-metrics-certs\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.026663 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.026641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8fqg\" (UniqueName: \"kubernetes.io/projected/6720a3a7-8da7-4737-8099-4478d0b8c564-kube-api-access-r8fqg\") pod \"maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.043665 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.043640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.341691 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.341657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"]
Sep 10 11:37:30.343637 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:37:30.343600    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6720a3a7_8da7_4737_8099_4478d0b8c564.slice/crio-31c9feba4f9356ad434818b721256e42d72d780e5f6a6f6f334a068fda8c184d WatchSource:0}: Error finding container 31c9feba4f9356ad434818b721256e42d72d780e5f6a6f6f334a068fda8c184d: Status 404 returned error can't find the container with id 31c9feba4f9356ad434818b721256e42d72d780e5f6a6f6f334a068fda8c184d
Sep 10 11:37:30.963107 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.963069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq" event={"ID":"6720a3a7-8da7-4737-8099-4478d0b8c564","Type":"ContainerStarted","Data":"fb9e9defd15c4a6bd9b52b3379358ed536795a79933e1e7a53e3f56f0019114d"}
Sep 10 11:37:30.963569 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.963133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq" event={"ID":"6720a3a7-8da7-4737-8099-4478d0b8c564","Type":"ContainerStarted","Data":"31c9feba4f9356ad434818b721256e42d72d780e5f6a6f6f334a068fda8c184d"}
Sep 10 11:37:30.963569 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.963164    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:37:30.987019 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:30.986934    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq" podStartSLOduration=1.596543351 podStartE2EDuration="1.986914054s" totalImagesPullingTime="390.370703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:37:30.984245261 +0000 UTC m=+1375.078446922" watchObservedRunningTime="2026-09-10 11:37:30.986914054 +0000 UTC m=+1375.081115715"
Sep 10 11:37:36.974236 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:37:36.974204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:38:12.266849 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.266815    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"]
Sep 10 11:38:12.267384 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.267136    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" podUID="1a87b302-a371-480c-a9a2-8e345edbd6ae" containerName="maas-api" containerID="cri-o://0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760" gracePeriod=30
Sep 10 11:38:12.521936 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.521875    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:38:12.694788 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.694757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-metrics-certs\") pod \"1a87b302-a371-480c-a9a2-8e345edbd6ae\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") "
Sep 10 11:38:12.694975 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.694908    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls\") pod \"1a87b302-a371-480c-a9a2-8e345edbd6ae\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") "
Sep 10 11:38:12.694975 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.694956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a87b302-a371-480c-a9a2-8e345edbd6ae-openshift-service-ca\") pod \"1a87b302-a371-480c-a9a2-8e345edbd6ae\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") "
Sep 10 11:38:12.695072 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.695001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w22ls\" (UniqueName: \"kubernetes.io/projected/1a87b302-a371-480c-a9a2-8e345edbd6ae-kube-api-access-w22ls\") pod \"1a87b302-a371-480c-a9a2-8e345edbd6ae\" (UID: \"1a87b302-a371-480c-a9a2-8e345edbd6ae\") "
Sep 10 11:38:12.695480 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.695448    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a87b302-a371-480c-a9a2-8e345edbd6ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a87b302-a371-480c-a9a2-8e345edbd6ae" (UID: "1a87b302-a371-480c-a9a2-8e345edbd6ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:38:12.697642 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.697609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a87b302-a371-480c-a9a2-8e345edbd6ae-kube-api-access-w22ls" (OuterVolumeSpecName: "kube-api-access-w22ls") pod "1a87b302-a371-480c-a9a2-8e345edbd6ae" (UID: "1a87b302-a371-480c-a9a2-8e345edbd6ae"). InnerVolumeSpecName "kube-api-access-w22ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:38:12.697642 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.697621    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1a87b302-a371-480c-a9a2-8e345edbd6ae" (UID: "1a87b302-a371-480c-a9a2-8e345edbd6ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:38:12.697818 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.697690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a87b302-a371-480c-a9a2-8e345edbd6ae" (UID: "1a87b302-a371-480c-a9a2-8e345edbd6ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:38:12.796707 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.796650    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w22ls\" (UniqueName: \"kubernetes.io/projected/1a87b302-a371-480c-a9a2-8e345edbd6ae-kube-api-access-w22ls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:12.796707 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.796673    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:12.796707 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.796682    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a87b302-a371-480c-a9a2-8e345edbd6ae-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:12.796707 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:12.796691    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a87b302-a371-480c-a9a2-8e345edbd6ae-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:13.200455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.200364    2580 generic.go:356] "Generic (PLEG): container finished" podID="1a87b302-a371-480c-a9a2-8e345edbd6ae" containerID="0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760" exitCode=0
Sep 10 11:38:13.200455 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.200415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"
Sep 10 11:38:13.200719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.200447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" event={"ID":"1a87b302-a371-480c-a9a2-8e345edbd6ae","Type":"ContainerDied","Data":"0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760"}
Sep 10 11:38:13.200719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.200503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v" event={"ID":"1a87b302-a371-480c-a9a2-8e345edbd6ae","Type":"ContainerDied","Data":"b5c49c7e2c50246bb26c1e27aa40a8608ed352a24e514f06df942397c2ddfd7f"}
Sep 10 11:38:13.200719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.200541    2580 scope.go:117] "RemoveContainer" containerID="0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760"
Sep 10 11:38:13.210386 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.210371    2580 scope.go:117] "RemoveContainer" containerID="0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760"
Sep 10 11:38:13.210692 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:38:13.210670    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760\": container with ID starting with 0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760 not found: ID does not exist" containerID="0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760"
Sep 10 11:38:13.210781 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.210698    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760"} err="failed to get container status \"0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760\": rpc error: code = NotFound desc = could not find container \"0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760\": container with ID starting with 0e8a6e39e56f98e2aad7e2f549b8eb753087880fb88d4bd396b514a80ef42760 not found: ID does not exist"
Sep 10 11:38:13.224847 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.224827    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"]
Sep 10 11:38:13.228988 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:13.228963    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e89227-6976f4f5d8-rl25v"]
Sep 10 11:38:14.419748 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:14.419709    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a87b302-a371-480c-a9a2-8e345edbd6ae" path="/var/lib/kubelet/pods/1a87b302-a371-480c-a9a2-8e345edbd6ae/volumes"
Sep 10 11:38:36.121167 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.121090    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"]
Sep 10 11:38:36.121678 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.121303    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq" podUID="6720a3a7-8da7-4737-8099-4478d0b8c564" containerName="maas-api" containerID="cri-o://fb9e9defd15c4a6bd9b52b3379358ed536795a79933e1e7a53e3f56f0019114d" gracePeriod=30
Sep 10 11:38:36.340361 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.340318    2580 generic.go:356] "Generic (PLEG): container finished" podID="6720a3a7-8da7-4737-8099-4478d0b8c564" containerID="fb9e9defd15c4a6bd9b52b3379358ed536795a79933e1e7a53e3f56f0019114d" exitCode=0
Sep 10 11:38:36.340551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.340457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq" event={"ID":"6720a3a7-8da7-4737-8099-4478d0b8c564","Type":"ContainerDied","Data":"fb9e9defd15c4a6bd9b52b3379358ed536795a79933e1e7a53e3f56f0019114d"}
Sep 10 11:38:36.376205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.376154    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:38:36.499665 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.499639    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8fqg\" (UniqueName: \"kubernetes.io/projected/6720a3a7-8da7-4737-8099-4478d0b8c564-kube-api-access-r8fqg\") pod \"6720a3a7-8da7-4737-8099-4478d0b8c564\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") "
Sep 10 11:38:36.499826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.499678    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-metrics-certs\") pod \"6720a3a7-8da7-4737-8099-4478d0b8c564\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") "
Sep 10 11:38:36.499826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.499714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6720a3a7-8da7-4737-8099-4478d0b8c564-openshift-service-ca\") pod \"6720a3a7-8da7-4737-8099-4478d0b8c564\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") "
Sep 10 11:38:36.499826 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.499784    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-maas-api-tls\") pod \"6720a3a7-8da7-4737-8099-4478d0b8c564\" (UID: \"6720a3a7-8da7-4737-8099-4478d0b8c564\") "
Sep 10 11:38:36.500103 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.500073    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6720a3a7-8da7-4737-8099-4478d0b8c564-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6720a3a7-8da7-4737-8099-4478d0b8c564" (UID: "6720a3a7-8da7-4737-8099-4478d0b8c564"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:38:36.502227 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.502148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6720a3a7-8da7-4737-8099-4478d0b8c564" (UID: "6720a3a7-8da7-4737-8099-4478d0b8c564"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:38:36.502227 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.502173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6720a3a7-8da7-4737-8099-4478d0b8c564-kube-api-access-r8fqg" (OuterVolumeSpecName: "kube-api-access-r8fqg") pod "6720a3a7-8da7-4737-8099-4478d0b8c564" (UID: "6720a3a7-8da7-4737-8099-4478d0b8c564"). InnerVolumeSpecName "kube-api-access-r8fqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:38:36.502227 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.502217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6720a3a7-8da7-4737-8099-4478d0b8c564" (UID: "6720a3a7-8da7-4737-8099-4478d0b8c564"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:38:36.600775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.600749    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8fqg\" (UniqueName: \"kubernetes.io/projected/6720a3a7-8da7-4737-8099-4478d0b8c564-kube-api-access-r8fqg\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:36.600775 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.600775    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:36.600911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.600784    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6720a3a7-8da7-4737-8099-4478d0b8c564-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:36.600911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:36.600793    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6720a3a7-8da7-4737-8099-4478d0b8c564-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:37.347945 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:37.347912    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"
Sep 10 11:38:37.347945 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:37.347932    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq" event={"ID":"6720a3a7-8da7-4737-8099-4478d0b8c564","Type":"ContainerDied","Data":"31c9feba4f9356ad434818b721256e42d72d780e5f6a6f6f334a068fda8c184d"}
Sep 10 11:38:37.348382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:37.347990    2580 scope.go:117] "RemoveContainer" containerID="fb9e9defd15c4a6bd9b52b3379358ed536795a79933e1e7a53e3f56f0019114d"
Sep 10 11:38:37.373897 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:37.373867    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"]
Sep 10 11:38:37.380230 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:37.380206    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7a970e-6b7bdf58b7-4p7tq"]
Sep 10 11:38:38.419406 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:38.419367    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6720a3a7-8da7-4737-8099-4478d0b8c564" path="/var/lib/kubelet/pods/6720a3a7-8da7-4737-8099-4478d0b8c564/volumes"
Sep 10 11:38:54.459312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.459267    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"]
Sep 10 11:38:54.459925 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.459502    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" podUID="40840aa2-581c-4533-a26b-e0133f4b2639" containerName="maas-api" containerID="cri-o://5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65" gracePeriod=30
Sep 10 11:38:54.716941 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.716876    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:38:54.864823 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.864776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-metrics-certs\") pod \"40840aa2-581c-4533-a26b-e0133f4b2639\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") "
Sep 10 11:38:54.865010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.864921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40840aa2-581c-4533-a26b-e0133f4b2639-openshift-service-ca\") pod \"40840aa2-581c-4533-a26b-e0133f4b2639\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") "
Sep 10 11:38:54.865010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.864983    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxzhd\" (UniqueName: \"kubernetes.io/projected/40840aa2-581c-4533-a26b-e0133f4b2639-kube-api-access-jxzhd\") pod \"40840aa2-581c-4533-a26b-e0133f4b2639\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") "
Sep 10 11:38:54.865127 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.865019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls\") pod \"40840aa2-581c-4533-a26b-e0133f4b2639\" (UID: \"40840aa2-581c-4533-a26b-e0133f4b2639\") "
Sep 10 11:38:54.865364 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.865316    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40840aa2-581c-4533-a26b-e0133f4b2639-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40840aa2-581c-4533-a26b-e0133f4b2639" (UID: "40840aa2-581c-4533-a26b-e0133f4b2639"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:38:54.867283 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.867250    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40840aa2-581c-4533-a26b-e0133f4b2639-kube-api-access-jxzhd" (OuterVolumeSpecName: "kube-api-access-jxzhd") pod "40840aa2-581c-4533-a26b-e0133f4b2639" (UID: "40840aa2-581c-4533-a26b-e0133f4b2639"). InnerVolumeSpecName "kube-api-access-jxzhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:38:54.867687 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.867666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "40840aa2-581c-4533-a26b-e0133f4b2639" (UID: "40840aa2-581c-4533-a26b-e0133f4b2639"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:38:54.867777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.867743    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40840aa2-581c-4533-a26b-e0133f4b2639" (UID: "40840aa2-581c-4533-a26b-e0133f4b2639"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:38:54.966028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.965991    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxzhd\" (UniqueName: \"kubernetes.io/projected/40840aa2-581c-4533-a26b-e0133f4b2639-kube-api-access-jxzhd\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:54.966028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.966022    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:54.966028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.966031    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40840aa2-581c-4533-a26b-e0133f4b2639-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:54.966250 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:54.966040    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40840aa2-581c-4533-a26b-e0133f4b2639-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:38:55.465470 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.465436    2580 generic.go:356] "Generic (PLEG): container finished" podID="40840aa2-581c-4533-a26b-e0133f4b2639" containerID="5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65" exitCode=0
Sep 10 11:38:55.465911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.465483    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"
Sep 10 11:38:55.465911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.465551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" event={"ID":"40840aa2-581c-4533-a26b-e0133f4b2639","Type":"ContainerDied","Data":"5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65"}
Sep 10 11:38:55.465911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.465602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx" event={"ID":"40840aa2-581c-4533-a26b-e0133f4b2639","Type":"ContainerDied","Data":"af0ba50458326b6701492984870d17da99ccef4a483af5a9f0434c98a3a267ea"}
Sep 10 11:38:55.465911 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.465626    2580 scope.go:117] "RemoveContainer" containerID="5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65"
Sep 10 11:38:55.476109 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.476095    2580 scope.go:117] "RemoveContainer" containerID="5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65"
Sep 10 11:38:55.476371 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:38:55.476352    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65\": container with ID starting with 5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65 not found: ID does not exist" containerID="5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65"
Sep 10 11:38:55.476435 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.476382    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65"} err="failed to get container status \"5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65\": rpc error: code = NotFound desc = could not find container \"5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65\": container with ID starting with 5ec47adb9dc2548ebad4525718db35b58f580af7f9096d72a76a4072c09e9b65 not found: ID does not exist"
Sep 10 11:38:55.492820 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.492793    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"]
Sep 10 11:38:55.498482 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:55.498464    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c2e44c-6cc4b748b9-jxsfx"]
Sep 10 11:38:56.419646 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:38:56.419612    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40840aa2-581c-4533-a26b-e0133f4b2639" path="/var/lib/kubelet/pods/40840aa2-581c-4533-a26b-e0133f4b2639/volumes"
Sep 10 11:39:13.745012 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:13.744972    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"]
Sep 10 11:39:13.745501 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:13.745170    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" podUID="ba94190a-a641-48ac-9e43-f60fb0fa03c0" containerName="maas-api" containerID="cri-o://34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd" gracePeriod=30
Sep 10 11:39:14.003211 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.003156    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:39:14.046174 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.046146    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-metrics-certs\") pod \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") "
Sep 10 11:39:14.046340 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.046182    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls\") pod \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") "
Sep 10 11:39:14.046340 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.046242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppc47\" (UniqueName: \"kubernetes.io/projected/ba94190a-a641-48ac-9e43-f60fb0fa03c0-kube-api-access-ppc47\") pod \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") "
Sep 10 11:39:14.046340 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.046312    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba94190a-a641-48ac-9e43-f60fb0fa03c0-openshift-service-ca\") pod \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\" (UID: \"ba94190a-a641-48ac-9e43-f60fb0fa03c0\") "
Sep 10 11:39:14.046806 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.046773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba94190a-a641-48ac-9e43-f60fb0fa03c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba94190a-a641-48ac-9e43-f60fb0fa03c0" (UID: "ba94190a-a641-48ac-9e43-f60fb0fa03c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:39:14.049106 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.049043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ba94190a-a641-48ac-9e43-f60fb0fa03c0" (UID: "ba94190a-a641-48ac-9e43-f60fb0fa03c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:39:14.049231 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.049185    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba94190a-a641-48ac-9e43-f60fb0fa03c0-kube-api-access-ppc47" (OuterVolumeSpecName: "kube-api-access-ppc47") pod "ba94190a-a641-48ac-9e43-f60fb0fa03c0" (UID: "ba94190a-a641-48ac-9e43-f60fb0fa03c0"). InnerVolumeSpecName "kube-api-access-ppc47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:39:14.049415 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.049389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba94190a-a641-48ac-9e43-f60fb0fa03c0" (UID: "ba94190a-a641-48ac-9e43-f60fb0fa03c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:39:14.148076 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.148050    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppc47\" (UniqueName: \"kubernetes.io/projected/ba94190a-a641-48ac-9e43-f60fb0fa03c0-kube-api-access-ppc47\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:39:14.148076 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.148076    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba94190a-a641-48ac-9e43-f60fb0fa03c0-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:39:14.148223 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.148085    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:39:14.148223 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.148094    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba94190a-a641-48ac-9e43-f60fb0fa03c0-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:39:14.424331 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.424264    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"]
Sep 10 11:39:14.424950 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.424933    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a87b302-a371-480c-a9a2-8e345edbd6ae" containerName="maas-api"
Sep 10 11:39:14.425042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.424956    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a87b302-a371-480c-a9a2-8e345edbd6ae" containerName="maas-api"
Sep 10 11:39:14.425042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.424984    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba94190a-a641-48ac-9e43-f60fb0fa03c0" containerName="maas-api"
Sep 10 11:39:14.425042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.424992    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba94190a-a641-48ac-9e43-f60fb0fa03c0" containerName="maas-api"
Sep 10 11:39:14.425042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425028    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6720a3a7-8da7-4737-8099-4478d0b8c564" containerName="maas-api"
Sep 10 11:39:14.425042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425037    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6720a3a7-8da7-4737-8099-4478d0b8c564" containerName="maas-api"
Sep 10 11:39:14.425194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425049    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40840aa2-581c-4533-a26b-e0133f4b2639" containerName="maas-api"
Sep 10 11:39:14.425194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425058    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="40840aa2-581c-4533-a26b-e0133f4b2639" containerName="maas-api"
Sep 10 11:39:14.425194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425147    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="40840aa2-581c-4533-a26b-e0133f4b2639" containerName="maas-api"
Sep 10 11:39:14.425194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425161    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a87b302-a371-480c-a9a2-8e345edbd6ae" containerName="maas-api"
Sep 10 11:39:14.425194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425171    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba94190a-a641-48ac-9e43-f60fb0fa03c0" containerName="maas-api"
Sep 10 11:39:14.425194 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.425181    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6720a3a7-8da7-4737-8099-4478d0b8c564" containerName="maas-api"
Sep 10 11:39:14.429575 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.429553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.433065 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.433043    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-3f4d4b-serving-cert\""
Sep 10 11:39:14.439884 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.439367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"]
Sep 10 11:39:14.551967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.551930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bb4c7c-1d08-4101-868b-5f1b6827a71b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.551967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.551972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.552179 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.551998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-metrics-certs\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.552179 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.552119    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvx9w\" (UniqueName: \"kubernetes.io/projected/62bb4c7c-1d08-4101-868b-5f1b6827a71b-kube-api-access-kvx9w\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.575028 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.574996    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba94190a-a641-48ac-9e43-f60fb0fa03c0" containerID="34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd" exitCode=0
Sep 10 11:39:14.575157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.575036    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"
Sep 10 11:39:14.575157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.575082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" event={"ID":"ba94190a-a641-48ac-9e43-f60fb0fa03c0","Type":"ContainerDied","Data":"34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd"}
Sep 10 11:39:14.575257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.575173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph" event={"ID":"ba94190a-a641-48ac-9e43-f60fb0fa03c0","Type":"ContainerDied","Data":"0b5c9246e803e1f98e02f30bc4d3eec54cc1f136890c4c37617a985efe6d8cae"}
Sep 10 11:39:14.575257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.575205    2580 scope.go:117] "RemoveContainer" containerID="34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd"
Sep 10 11:39:14.586177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.586155    2580 scope.go:117] "RemoveContainer" containerID="34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd"
Sep 10 11:39:14.586510 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:39:14.586489    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd\": container with ID starting with 34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd not found: ID does not exist" containerID="34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd"
Sep 10 11:39:14.586621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.586520    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd"} err="failed to get container status \"34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd\": rpc error: code = NotFound desc = could not find container \"34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd\": container with ID starting with 34e11ebfe01b43a145454fec08cc1aaf40801ce718a7258e0a7180ae400af9fd not found: ID does not exist"
Sep 10 11:39:14.599419 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.599397    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"]
Sep 10 11:39:14.604509 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.604488    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-282355-78dc6bf6d-dz2ph"]
Sep 10 11:39:14.652765 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.652741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvx9w\" (UniqueName: \"kubernetes.io/projected/62bb4c7c-1d08-4101-868b-5f1b6827a71b-kube-api-access-kvx9w\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.652860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.652802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bb4c7c-1d08-4101-868b-5f1b6827a71b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.652860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.652837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.652931 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.652867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-metrics-certs\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.653452 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.653391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bb4c7c-1d08-4101-868b-5f1b6827a71b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.655263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.655246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.655382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.655367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-metrics-certs\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.666755 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.666737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvx9w\" (UniqueName: \"kubernetes.io/projected/62bb4c7c-1d08-4101-868b-5f1b6827a71b-kube-api-access-kvx9w\") pod \"maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:14.743629 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:14.743605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:15.034087 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:15.034059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"]
Sep 10 11:39:15.035097 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:39:15.035071    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bb4c7c_1d08_4101_868b_5f1b6827a71b.slice/crio-8316f07db2d0901472963f247d869697a139eb87ef75fcdeb68dd01ea3bddeb7 WatchSource:0}: Error finding container 8316f07db2d0901472963f247d869697a139eb87ef75fcdeb68dd01ea3bddeb7: Status 404 returned error can't find the container with id 8316f07db2d0901472963f247d869697a139eb87ef75fcdeb68dd01ea3bddeb7
Sep 10 11:39:15.584081 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:15.584052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" event={"ID":"62bb4c7c-1d08-4101-868b-5f1b6827a71b","Type":"ContainerStarted","Data":"1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0"}
Sep 10 11:39:15.584232 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:15.584099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" event={"ID":"62bb4c7c-1d08-4101-868b-5f1b6827a71b","Type":"ContainerStarted","Data":"8316f07db2d0901472963f247d869697a139eb87ef75fcdeb68dd01ea3bddeb7"}
Sep 10 11:39:15.584232 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:15.584179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:15.618692 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:15.618651    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" podStartSLOduration=1.162824682 podStartE2EDuration="1.618635966s" totalImagesPullingTime="455.811284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:39:15.617330305 +0000 UTC m=+1479.711531965" watchObservedRunningTime="2026-09-10 11:39:15.618635966 +0000 UTC m=+1479.712837627"
Sep 10 11:39:16.420200 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:16.420168    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba94190a-a641-48ac-9e43-f60fb0fa03c0" path="/var/lib/kubelet/pods/ba94190a-a641-48ac-9e43-f60fb0fa03c0/volumes"
Sep 10 11:39:21.595798 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:21.595761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:39:43.883478 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.883436    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"]
Sep 10 11:39:43.892738 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.892713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:43.895930 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.895900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-420024-serving-cert\""
Sep 10 11:39:43.898980 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.898904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"]
Sep 10 11:39:43.912397 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.912371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jvmr\" (UniqueName: \"kubernetes.io/projected/bea41d90-3334-49f1-8577-18c5abfd244f-kube-api-access-2jvmr\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:43.912494 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.912478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:43.912575 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.912501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea41d90-3334-49f1-8577-18c5abfd244f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:43.912575 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:43.912516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-metrics-certs\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.013184 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.013146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.013184 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.013183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea41d90-3334-49f1-8577-18c5abfd244f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.013423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.013209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-metrics-certs\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.013423 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.013279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jvmr\" (UniqueName: \"kubernetes.io/projected/bea41d90-3334-49f1-8577-18c5abfd244f-kube-api-access-2jvmr\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.013423 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:39:44.013284    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-serving-cert: secret "maas-api-e2e-ipp-b-420024-serving-cert" not found
Sep 10 11:39:44.013423 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:39:44.013348    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls podName:bea41d90-3334-49f1-8577-18c5abfd244f nodeName:}" failed. No retries permitted until 2026-09-10 11:39:44.513330642 +0000 UTC m=+1508.607532280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls") pod "maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" (UID: "bea41d90-3334-49f1-8577-18c5abfd244f") : secret "maas-api-e2e-ipp-b-420024-serving-cert" not found
Sep 10 11:39:44.013901 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.013883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea41d90-3334-49f1-8577-18c5abfd244f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.015982 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.015962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-metrics-certs\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.025581 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.025558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jvmr\" (UniqueName: \"kubernetes.io/projected/bea41d90-3334-49f1-8577-18c5abfd244f-kube-api-access-2jvmr\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.518629 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.518599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.521262 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.521239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:44.807205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:44.807029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:45.089095 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:45.089066    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"]
Sep 10 11:39:45.090000 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:39:45.089974    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea41d90_3334_49f1_8577_18c5abfd244f.slice/crio-3fe426620be9bd770fdb9f599ff5aab328ca8527360c3bf10e01f8b9e7303752 WatchSource:0}: Error finding container 3fe426620be9bd770fdb9f599ff5aab328ca8527360c3bf10e01f8b9e7303752: Status 404 returned error can't find the container with id 3fe426620be9bd770fdb9f599ff5aab328ca8527360c3bf10e01f8b9e7303752
Sep 10 11:39:45.766042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:45.765963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" event={"ID":"bea41d90-3334-49f1-8577-18c5abfd244f","Type":"ContainerStarted","Data":"1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32"}
Sep 10 11:39:45.766042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:45.766012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" event={"ID":"bea41d90-3334-49f1-8577-18c5abfd244f","Type":"ContainerStarted","Data":"3fe426620be9bd770fdb9f599ff5aab328ca8527360c3bf10e01f8b9e7303752"}
Sep 10 11:39:45.766042 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:45.766034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:39:45.799080 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:45.799032    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" podStartSLOduration=2.387135045 podStartE2EDuration="2.799017123s" totalImagesPullingTime="411.882078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:39:45.796937171 +0000 UTC m=+1509.891138830" watchObservedRunningTime="2026-09-10 11:39:45.799017123 +0000 UTC m=+1509.893218782"
Sep 10 11:39:51.776500 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:39:51.776470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:40:12.931119 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:12.931085    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-tpc7d_84b23144-10e7-49e3-87d8-bbac53e8f183/payload-processing/0.log"
Sep 10 11:40:43.774693 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:43.774656    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-tpc7d_84b23144-10e7-49e3-87d8-bbac53e8f183/payload-processing/0.log"
Sep 10 11:40:48.980257 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:48.980221    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"]
Sep 10 11:40:48.984328 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:48.984307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:48.988288 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:48.988268    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-34501f-serving-cert\""
Sep 10 11:40:48.999960 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:48.999935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"]
Sep 10 11:40:49.074159 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.074133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.074330 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.074213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47b3e451-2e94-43b5-bdcc-8df50ef98d33-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.074330 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.074304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6f7g\" (UniqueName: \"kubernetes.io/projected/47b3e451-2e94-43b5-bdcc-8df50ef98d33-kube-api-access-t6f7g\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.074431 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.074366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.175374 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.175337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.175521 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.175433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47b3e451-2e94-43b5-bdcc-8df50ef98d33-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.175521 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.175483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6f7g\" (UniqueName: \"kubernetes.io/projected/47b3e451-2e94-43b5-bdcc-8df50ef98d33-kube-api-access-t6f7g\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.175521 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:40:49.175491    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-serving-cert: secret "maas-api-e2e-ipp-cleanup-34501f-serving-cert" not found
Sep 10 11:40:49.175704 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.175522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.175704 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:40:49.175599    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls podName:47b3e451-2e94-43b5-bdcc-8df50ef98d33 nodeName:}" failed. No retries permitted until 2026-09-10 11:40:49.675579281 +0000 UTC m=+1573.769780936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" (UID: "47b3e451-2e94-43b5-bdcc-8df50ef98d33") : secret "maas-api-e2e-ipp-cleanup-34501f-serving-cert" not found
Sep 10 11:40:49.176253 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.176194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47b3e451-2e94-43b5-bdcc-8df50ef98d33-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.178119 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.178096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.188898 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.188869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6f7g\" (UniqueName: \"kubernetes.io/projected/47b3e451-2e94-43b5-bdcc-8df50ef98d33-kube-api-access-t6f7g\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.680959 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.680928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.683337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.683314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:49.893834 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:49.893806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:50.168007 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:50.167972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"]
Sep 10 11:40:50.169278 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:40:50.169253    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b3e451_2e94_43b5_bdcc_8df50ef98d33.slice/crio-520a8333ff2266b9b45f489d9b9fb546495960476532c98e62924a9bf422eb78 WatchSource:0}: Error finding container 520a8333ff2266b9b45f489d9b9fb546495960476532c98e62924a9bf422eb78: Status 404 returned error can't find the container with id 520a8333ff2266b9b45f489d9b9fb546495960476532c98e62924a9bf422eb78
Sep 10 11:40:51.143772 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:51.143736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" event={"ID":"47b3e451-2e94-43b5-bdcc-8df50ef98d33","Type":"ContainerStarted","Data":"e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4"}
Sep 10 11:40:51.143962 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:51.143789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" event={"ID":"47b3e451-2e94-43b5-bdcc-8df50ef98d33","Type":"ContainerStarted","Data":"520a8333ff2266b9b45f489d9b9fb546495960476532c98e62924a9bf422eb78"}
Sep 10 11:40:51.143962 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:51.143809    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:40:51.172628 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:51.172579    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" podStartSLOduration=2.821846419 podStartE2EDuration="3.172563193s" totalImagesPullingTime="350.716774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:40:51.169747632 +0000 UTC m=+1575.263949309" watchObservedRunningTime="2026-09-10 11:40:51.172563193 +0000 UTC m=+1575.266764858"
Sep 10 11:40:57.156217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:40:57.156188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:41:19.815543 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:19.815488    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"]
Sep 10 11:41:19.816017 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:19.815774    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" podUID="47b3e451-2e94-43b5-bdcc-8df50ef98d33" containerName="maas-api" containerID="cri-o://e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4" gracePeriod=30
Sep 10 11:41:20.062903 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.062881    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:41:20.261190 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.261155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47b3e451-2e94-43b5-bdcc-8df50ef98d33-openshift-service-ca\") pod \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") "
Sep 10 11:41:20.261378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.261209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6f7g\" (UniqueName: \"kubernetes.io/projected/47b3e451-2e94-43b5-bdcc-8df50ef98d33-kube-api-access-t6f7g\") pod \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") "
Sep 10 11:41:20.261378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.261295    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls\") pod \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") "
Sep 10 11:41:20.261378 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.261320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-metrics-certs\") pod \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\" (UID: \"47b3e451-2e94-43b5-bdcc-8df50ef98d33\") "
Sep 10 11:41:20.261588 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.261503    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47b3e451-2e94-43b5-bdcc-8df50ef98d33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "47b3e451-2e94-43b5-bdcc-8df50ef98d33" (UID: "47b3e451-2e94-43b5-bdcc-8df50ef98d33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:41:20.261656 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.261613    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47b3e451-2e94-43b5-bdcc-8df50ef98d33-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:20.263410 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.263383    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "47b3e451-2e94-43b5-bdcc-8df50ef98d33" (UID: "47b3e451-2e94-43b5-bdcc-8df50ef98d33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:41:20.263514 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.263428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b3e451-2e94-43b5-bdcc-8df50ef98d33-kube-api-access-t6f7g" (OuterVolumeSpecName: "kube-api-access-t6f7g") pod "47b3e451-2e94-43b5-bdcc-8df50ef98d33" (UID: "47b3e451-2e94-43b5-bdcc-8df50ef98d33"). InnerVolumeSpecName "kube-api-access-t6f7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:41:20.263514 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.263504    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "47b3e451-2e94-43b5-bdcc-8df50ef98d33" (UID: "47b3e451-2e94-43b5-bdcc-8df50ef98d33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:41:20.301617 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.301590    2580 generic.go:356] "Generic (PLEG): container finished" podID="47b3e451-2e94-43b5-bdcc-8df50ef98d33" containerID="e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4" exitCode=0
Sep 10 11:41:20.301714 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.301648    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"
Sep 10 11:41:20.301714 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.301650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" event={"ID":"47b3e451-2e94-43b5-bdcc-8df50ef98d33","Type":"ContainerDied","Data":"e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4"}
Sep 10 11:41:20.301714 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.301703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf" event={"ID":"47b3e451-2e94-43b5-bdcc-8df50ef98d33","Type":"ContainerDied","Data":"520a8333ff2266b9b45f489d9b9fb546495960476532c98e62924a9bf422eb78"}
Sep 10 11:41:20.301813 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.301732    2580 scope.go:117] "RemoveContainer" containerID="e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4"
Sep 10 11:41:20.311382 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.311366    2580 scope.go:117] "RemoveContainer" containerID="e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4"
Sep 10 11:41:20.311667 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:41:20.311649    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4\": container with ID starting with e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4 not found: ID does not exist" containerID="e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4"
Sep 10 11:41:20.311731 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.311675    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4"} err="failed to get container status \"e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4\": rpc error: code = NotFound desc = could not find container \"e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4\": container with ID starting with e2818997336c0e8afb63efebabcc4fc99dc5f12e1ea6b130fb28d6e7474b4ee4 not found: ID does not exist"
Sep 10 11:41:20.327575 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.327553    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"]
Sep 10 11:41:20.329807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.329790    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-34501f-85dcf9d8b4-ggdqf"]
Sep 10 11:41:20.362027 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.362004    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:20.362027 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.362023    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b3e451-2e94-43b5-bdcc-8df50ef98d33-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:20.362141 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.362032    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6f7g\" (UniqueName: \"kubernetes.io/projected/47b3e451-2e94-43b5-bdcc-8df50ef98d33-kube-api-access-t6f7g\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:20.419732 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:20.419705    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47b3e451-2e94-43b5-bdcc-8df50ef98d33" path="/var/lib/kubelet/pods/47b3e451-2e94-43b5-bdcc-8df50ef98d33/volumes"
Sep 10 11:41:46.475055 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.475019    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"]
Sep 10 11:41:46.475625 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.475259    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" podUID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" containerName="maas-api" containerID="cri-o://1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0" gracePeriod=30
Sep 10 11:41:46.591307 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.591267    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" podUID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.69:8443/health\": dial tcp 10.133.0.69:8443: connect: connection refused"
Sep 10 11:41:46.721782 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.721760    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:41:46.801476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.801406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-metrics-certs\") pod \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") "
Sep 10 11:41:46.802149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.801486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bb4c7c-1d08-4101-868b-5f1b6827a71b-openshift-service-ca\") pod \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") "
Sep 10 11:41:46.802149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.801522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-maas-api-tls\") pod \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") "
Sep 10 11:41:46.802149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.801639    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvx9w\" (UniqueName: \"kubernetes.io/projected/62bb4c7c-1d08-4101-868b-5f1b6827a71b-kube-api-access-kvx9w\") pod \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\" (UID: \"62bb4c7c-1d08-4101-868b-5f1b6827a71b\") "
Sep 10 11:41:46.802149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.801831    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62bb4c7c-1d08-4101-868b-5f1b6827a71b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62bb4c7c-1d08-4101-868b-5f1b6827a71b" (UID: "62bb4c7c-1d08-4101-868b-5f1b6827a71b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:41:46.802149 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.802012    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62bb4c7c-1d08-4101-868b-5f1b6827a71b-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:46.803828 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.803800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "62bb4c7c-1d08-4101-868b-5f1b6827a71b" (UID: "62bb4c7c-1d08-4101-868b-5f1b6827a71b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:41:46.803828 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.803814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62bb4c7c-1d08-4101-868b-5f1b6827a71b" (UID: "62bb4c7c-1d08-4101-868b-5f1b6827a71b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:41:46.803828 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.803814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bb4c7c-1d08-4101-868b-5f1b6827a71b-kube-api-access-kvx9w" (OuterVolumeSpecName: "kube-api-access-kvx9w") pod "62bb4c7c-1d08-4101-868b-5f1b6827a71b" (UID: "62bb4c7c-1d08-4101-868b-5f1b6827a71b"). InnerVolumeSpecName "kube-api-access-kvx9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:41:46.902743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.902711    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:46.902743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.902742    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvx9w\" (UniqueName: \"kubernetes.io/projected/62bb4c7c-1d08-4101-868b-5f1b6827a71b-kube-api-access-kvx9w\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:46.902743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:46.902750    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bb4c7c-1d08-4101-868b-5f1b6827a71b-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:41:47.452041 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.452007    2580 generic.go:356] "Generic (PLEG): container finished" podID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" containerID="1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0" exitCode=0
Sep 10 11:41:47.452215 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.452050    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"
Sep 10 11:41:47.452215 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.452094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" event={"ID":"62bb4c7c-1d08-4101-868b-5f1b6827a71b","Type":"ContainerDied","Data":"1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0"}
Sep 10 11:41:47.452215 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.452145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg" event={"ID":"62bb4c7c-1d08-4101-868b-5f1b6827a71b","Type":"ContainerDied","Data":"8316f07db2d0901472963f247d869697a139eb87ef75fcdeb68dd01ea3bddeb7"}
Sep 10 11:41:47.452215 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.452169    2580 scope.go:117] "RemoveContainer" containerID="1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0"
Sep 10 11:41:47.462224 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.462206    2580 scope.go:117] "RemoveContainer" containerID="1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0"
Sep 10 11:41:47.462490 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:41:47.462473    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0\": container with ID starting with 1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0 not found: ID does not exist" containerID="1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0"
Sep 10 11:41:47.462572 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.462500    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0"} err="failed to get container status \"1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0\": rpc error: code = NotFound desc = could not find container \"1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0\": container with ID starting with 1c8e0a3c5b2c490d62f7f740ae31ef888dc85e2dd9fac51abd163b02c3aaeaa0 not found: ID does not exist"
Sep 10 11:41:47.474618 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.474597    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"]
Sep 10 11:41:47.479495 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:47.479476    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-3f4d4b-64fdb76d4f-klclg"]
Sep 10 11:41:48.419923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:41:48.419892    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" path="/var/lib/kubelet/pods/62bb4c7c-1d08-4101-868b-5f1b6827a71b/volumes"
Sep 10 11:42:47.222643 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.222609    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"]
Sep 10 11:42:47.223147 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.222851    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" podUID="bea41d90-3334-49f1-8577-18c5abfd244f" containerName="maas-api" containerID="cri-o://1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32" gracePeriod=30
Sep 10 11:42:47.471581 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.471558    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:42:47.550177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.550114    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls\") pod \"bea41d90-3334-49f1-8577-18c5abfd244f\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") "
Sep 10 11:42:47.550312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.550182    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea41d90-3334-49f1-8577-18c5abfd244f-openshift-service-ca\") pod \"bea41d90-3334-49f1-8577-18c5abfd244f\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") "
Sep 10 11:42:47.550312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.550240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jvmr\" (UniqueName: \"kubernetes.io/projected/bea41d90-3334-49f1-8577-18c5abfd244f-kube-api-access-2jvmr\") pod \"bea41d90-3334-49f1-8577-18c5abfd244f\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") "
Sep 10 11:42:47.550312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.550259    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-metrics-certs\") pod \"bea41d90-3334-49f1-8577-18c5abfd244f\" (UID: \"bea41d90-3334-49f1-8577-18c5abfd244f\") "
Sep 10 11:42:47.550482 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.550446    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea41d90-3334-49f1-8577-18c5abfd244f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bea41d90-3334-49f1-8577-18c5abfd244f" (UID: "bea41d90-3334-49f1-8577-18c5abfd244f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:42:47.552346 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.552319    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea41d90-3334-49f1-8577-18c5abfd244f-kube-api-access-2jvmr" (OuterVolumeSpecName: "kube-api-access-2jvmr") pod "bea41d90-3334-49f1-8577-18c5abfd244f" (UID: "bea41d90-3334-49f1-8577-18c5abfd244f"). InnerVolumeSpecName "kube-api-access-2jvmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:42:47.552452 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.552364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bea41d90-3334-49f1-8577-18c5abfd244f" (UID: "bea41d90-3334-49f1-8577-18c5abfd244f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:42:47.552452 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.552396    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bea41d90-3334-49f1-8577-18c5abfd244f" (UID: "bea41d90-3334-49f1-8577-18c5abfd244f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:42:47.651719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.651682    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jvmr\" (UniqueName: \"kubernetes.io/projected/bea41d90-3334-49f1-8577-18c5abfd244f-kube-api-access-2jvmr\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:42:47.651719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.651716    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:42:47.651957 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.651737    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea41d90-3334-49f1-8577-18c5abfd244f-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:42:47.651957 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.651749    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea41d90-3334-49f1-8577-18c5abfd244f-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:42:47.772882 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.772853    2580 generic.go:356] "Generic (PLEG): container finished" podID="bea41d90-3334-49f1-8577-18c5abfd244f" containerID="1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32" exitCode=0
Sep 10 11:42:47.773010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.772899    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"
Sep 10 11:42:47.773010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.772936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" event={"ID":"bea41d90-3334-49f1-8577-18c5abfd244f","Type":"ContainerDied","Data":"1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32"}
Sep 10 11:42:47.773010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.772991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86" event={"ID":"bea41d90-3334-49f1-8577-18c5abfd244f","Type":"ContainerDied","Data":"3fe426620be9bd770fdb9f599ff5aab328ca8527360c3bf10e01f8b9e7303752"}
Sep 10 11:42:47.773109 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.773015    2580 scope.go:117] "RemoveContainer" containerID="1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32"
Sep 10 11:42:47.785638 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.782729    2580 scope.go:117] "RemoveContainer" containerID="1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32"
Sep 10 11:42:47.789637 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:42:47.789611    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32\": container with ID starting with 1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32 not found: ID does not exist" containerID="1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32"
Sep 10 11:42:47.789745 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.789646    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32"} err="failed to get container status \"1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32\": rpc error: code = NotFound desc = could not find container \"1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32\": container with ID starting with 1c2c28b90946a113e04e07644d5b68d1fed3f733ae866f3eef0eaf92d0463a32 not found: ID does not exist"
Sep 10 11:42:47.802287 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.802233    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"]
Sep 10 11:42:47.807594 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:47.807573    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-420024-76dc66bd5c-f4v86"]
Sep 10 11:42:48.418896 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:42:48.418865    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea41d90-3334-49f1-8577-18c5abfd244f" path="/var/lib/kubelet/pods/bea41d90-3334-49f1-8577-18c5abfd244f/volumes"
Sep 10 11:43:06.356460 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.356419    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"]
Sep 10 11:43:06.356937 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.356652    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" podUID="681d1a4f-fbb5-417b-bb15-bde1f3913bfc" containerName="maas-api" containerID="cri-o://bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2" gracePeriod=30
Sep 10 11:43:06.608815 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.608758    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:43:06.728156 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.728126    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls\") pod \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") "
Sep 10 11:43:06.728325 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.728177    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs2c7\" (UniqueName: \"kubernetes.io/projected/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-kube-api-access-fs2c7\") pod \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") "
Sep 10 11:43:06.728325 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.728247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-metrics-certs\") pod \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") "
Sep 10 11:43:06.728452 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.728336    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-openshift-service-ca\") pod \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\" (UID: \"681d1a4f-fbb5-417b-bb15-bde1f3913bfc\") "
Sep 10 11:43:06.729073 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.729040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "681d1a4f-fbb5-417b-bb15-bde1f3913bfc" (UID: "681d1a4f-fbb5-417b-bb15-bde1f3913bfc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:43:06.730333 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.730309    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "681d1a4f-fbb5-417b-bb15-bde1f3913bfc" (UID: "681d1a4f-fbb5-417b-bb15-bde1f3913bfc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:43:06.730436 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.730356    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "681d1a4f-fbb5-417b-bb15-bde1f3913bfc" (UID: "681d1a4f-fbb5-417b-bb15-bde1f3913bfc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:43:06.730436 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.730426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-kube-api-access-fs2c7" (OuterVolumeSpecName: "kube-api-access-fs2c7") pod "681d1a4f-fbb5-417b-bb15-bde1f3913bfc" (UID: "681d1a4f-fbb5-417b-bb15-bde1f3913bfc"). InnerVolumeSpecName "kube-api-access-fs2c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:43:06.829166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.829138    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:06.829166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.829161    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:06.829166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.829172    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs2c7\" (UniqueName: \"kubernetes.io/projected/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-kube-api-access-fs2c7\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:06.829356 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.829180    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/681d1a4f-fbb5-417b-bb15-bde1f3913bfc-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:06.876432 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.876371    2580 generic.go:356] "Generic (PLEG): container finished" podID="681d1a4f-fbb5-417b-bb15-bde1f3913bfc" containerID="bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2" exitCode=0
Sep 10 11:43:06.876432 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.876422    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"
Sep 10 11:43:06.876617 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.876463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" event={"ID":"681d1a4f-fbb5-417b-bb15-bde1f3913bfc","Type":"ContainerDied","Data":"bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2"}
Sep 10 11:43:06.876617 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.876509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt" event={"ID":"681d1a4f-fbb5-417b-bb15-bde1f3913bfc","Type":"ContainerDied","Data":"8a5629752705108e680dfbcbc5a6fbdc8693e5c62c92539ded253aa1e919e53d"}
Sep 10 11:43:06.876617 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.876552    2580 scope.go:117] "RemoveContainer" containerID="bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2"
Sep 10 11:43:06.887411 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.887394    2580 scope.go:117] "RemoveContainer" containerID="bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2"
Sep 10 11:43:06.887760 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:43:06.887742    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2\": container with ID starting with bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2 not found: ID does not exist" containerID="bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2"
Sep 10 11:43:06.887834 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.887771    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2"} err="failed to get container status \"bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2\": rpc error: code = NotFound desc = could not find container \"bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2\": container with ID starting with bc75df2d6fd4174954d062e46731acc63699194b93f69ebb54b12c28d2dbfbe2 not found: ID does not exist"
Sep 10 11:43:06.900218 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.900199    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"]
Sep 10 11:43:06.905117 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:06.905097    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5fde2a-5f5bcc4758-v78zt"]
Sep 10 11:43:08.418295 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:08.418264    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="681d1a4f-fbb5-417b-bb15-bde1f3913bfc" path="/var/lib/kubelet/pods/681d1a4f-fbb5-417b-bb15-bde1f3913bfc/volumes"
Sep 10 11:43:24.663151 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.663112    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"]
Sep 10 11:43:24.663552 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.663346    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5" podUID="8c1bca54-2023-43ce-a608-2523ce5577e7" containerName="maas-api" containerID="cri-o://3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665" gracePeriod=30
Sep 10 11:43:24.914025 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.913957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:43:24.970874 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.970844    2580 generic.go:356] "Generic (PLEG): container finished" podID="8c1bca54-2023-43ce-a608-2523ce5577e7" containerID="3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665" exitCode=0
Sep 10 11:43:24.971015 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.970887    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"
Sep 10 11:43:24.971015 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.970936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5" event={"ID":"8c1bca54-2023-43ce-a608-2523ce5577e7","Type":"ContainerDied","Data":"3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665"}
Sep 10 11:43:24.971015 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.970985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5" event={"ID":"8c1bca54-2023-43ce-a608-2523ce5577e7","Type":"ContainerDied","Data":"b1208e668995b4caa6e327edff4642319ce93b68dcd1a98f0d64f5c3707fae3c"}
Sep 10 11:43:24.971015 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.971005    2580 scope.go:117] "RemoveContainer" containerID="3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665"
Sep 10 11:43:24.980286 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.980270    2580 scope.go:117] "RemoveContainer" containerID="3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665"
Sep 10 11:43:24.980526 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:43:24.980507    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665\": container with ID starting with 3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665 not found: ID does not exist" containerID="3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665"
Sep 10 11:43:24.980614 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:24.980565    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665"} err="failed to get container status \"3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665\": rpc error: code = NotFound desc = could not find container \"3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665\": container with ID starting with 3fdde2b66e968003f7d24dfa3f3a3be11f494e83e25b7fc259a7488889080665 not found: ID does not exist"
Sep 10 11:43:25.089658 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.089627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-metrics-certs\") pod \"8c1bca54-2023-43ce-a608-2523ce5577e7\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") "
Sep 10 11:43:25.089807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.089695    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxrg7\" (UniqueName: \"kubernetes.io/projected/8c1bca54-2023-43ce-a608-2523ce5577e7-kube-api-access-zxrg7\") pod \"8c1bca54-2023-43ce-a608-2523ce5577e7\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") "
Sep 10 11:43:25.089807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.089770    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1bca54-2023-43ce-a608-2523ce5577e7-openshift-service-ca\") pod \"8c1bca54-2023-43ce-a608-2523ce5577e7\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") "
Sep 10 11:43:25.089807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.089791    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-maas-api-tls\") pod \"8c1bca54-2023-43ce-a608-2523ce5577e7\" (UID: \"8c1bca54-2023-43ce-a608-2523ce5577e7\") "
Sep 10 11:43:25.090152 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.090123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c1bca54-2023-43ce-a608-2523ce5577e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c1bca54-2023-43ce-a608-2523ce5577e7" (UID: "8c1bca54-2023-43ce-a608-2523ce5577e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:43:25.091758 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.091735    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1bca54-2023-43ce-a608-2523ce5577e7-kube-api-access-zxrg7" (OuterVolumeSpecName: "kube-api-access-zxrg7") pod "8c1bca54-2023-43ce-a608-2523ce5577e7" (UID: "8c1bca54-2023-43ce-a608-2523ce5577e7"). InnerVolumeSpecName "kube-api-access-zxrg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:43:25.091867 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.091843    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8c1bca54-2023-43ce-a608-2523ce5577e7" (UID: "8c1bca54-2023-43ce-a608-2523ce5577e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:43:25.091918 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.091893    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c1bca54-2023-43ce-a608-2523ce5577e7" (UID: "8c1bca54-2023-43ce-a608-2523ce5577e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:43:25.191010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.190945    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxrg7\" (UniqueName: \"kubernetes.io/projected/8c1bca54-2023-43ce-a608-2523ce5577e7-kube-api-access-zxrg7\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:25.191010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.190967    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1bca54-2023-43ce-a608-2523ce5577e7-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:25.191010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.190976    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:25.191010 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.190984    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1bca54-2023-43ce-a608-2523ce5577e7-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:25.294250 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.294220    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"]
Sep 10 11:43:25.301273 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:25.301250    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-13c392-5f785bb85-w72q5"]
Sep 10 11:43:26.419807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:26.419772    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c1bca54-2023-43ce-a608-2523ce5577e7" path="/var/lib/kubelet/pods/8c1bca54-2023-43ce-a608-2523ce5577e7/volumes"
Sep 10 11:43:35.086600 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.086562    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686898fd-97wdq"]
Sep 10 11:43:35.086970 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.086740    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-686898fd-97wdq" podUID="983d0d34-e61d-435f-978a-b2e4c1d56d92" containerName="manager" containerID="cri-o://27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45" gracePeriod=30
Sep 10 11:43:35.817497 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.817475    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:43:35.884224 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.884193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-metrics-certs\") pod \"983d0d34-e61d-435f-978a-b2e4c1d56d92\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") "
Sep 10 11:43:35.884383 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.884245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g4pt\" (UniqueName: \"kubernetes.io/projected/983d0d34-e61d-435f-978a-b2e4c1d56d92-kube-api-access-6g4pt\") pod \"983d0d34-e61d-435f-978a-b2e4c1d56d92\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") "
Sep 10 11:43:35.884383 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.884270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-webhook-cert\") pod \"983d0d34-e61d-435f-978a-b2e4c1d56d92\" (UID: \"983d0d34-e61d-435f-978a-b2e4c1d56d92\") "
Sep 10 11:43:35.886477 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.886445    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "983d0d34-e61d-435f-978a-b2e4c1d56d92" (UID: "983d0d34-e61d-435f-978a-b2e4c1d56d92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:43:35.886622 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.886496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983d0d34-e61d-435f-978a-b2e4c1d56d92-kube-api-access-6g4pt" (OuterVolumeSpecName: "kube-api-access-6g4pt") pod "983d0d34-e61d-435f-978a-b2e4c1d56d92" (UID: "983d0d34-e61d-435f-978a-b2e4c1d56d92"). InnerVolumeSpecName "kube-api-access-6g4pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:43:35.886743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.886729    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "983d0d34-e61d-435f-978a-b2e4c1d56d92" (UID: "983d0d34-e61d-435f-978a-b2e4c1d56d92"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:43:35.985967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.985934    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:35.985967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.985959    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g4pt\" (UniqueName: \"kubernetes.io/projected/983d0d34-e61d-435f-978a-b2e4c1d56d92-kube-api-access-6g4pt\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:35.985967 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:35.985968    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/983d0d34-e61d-435f-978a-b2e4c1d56d92-webhook-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:43:36.033706 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.033676    2580 generic.go:356] "Generic (PLEG): container finished" podID="983d0d34-e61d-435f-978a-b2e4c1d56d92" containerID="27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45" exitCode=0
Sep 10 11:43:36.033851 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.033723    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-97wdq"
Sep 10 11:43:36.033851 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.033764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-97wdq" event={"ID":"983d0d34-e61d-435f-978a-b2e4c1d56d92","Type":"ContainerDied","Data":"27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45"}
Sep 10 11:43:36.033851 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.033815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-97wdq" event={"ID":"983d0d34-e61d-435f-978a-b2e4c1d56d92","Type":"ContainerDied","Data":"0ae7b10255f490eb71f5611d86fbfb2be9a87f4a5c163bf2f31127f107bdc2b8"}
Sep 10 11:43:36.033851 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.033837    2580 scope.go:117] "RemoveContainer" containerID="27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45"
Sep 10 11:43:36.043743 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.043718    2580 scope.go:117] "RemoveContainer" containerID="27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45"
Sep 10 11:43:36.044000 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:43:36.043982    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45\": container with ID starting with 27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45 not found: ID does not exist" containerID="27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45"
Sep 10 11:43:36.044072 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.044010    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45"} err="failed to get container status \"27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45\": rpc error: code = NotFound desc = could not find container \"27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45\": container with ID starting with 27b14295f07d4ff80e9c409c641d3244f6a020612fcea75d9ffdccfcf433ff45 not found: ID does not exist"
Sep 10 11:43:36.057255 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.057234    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686898fd-97wdq"]
Sep 10 11:43:36.066217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.066193    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-686898fd-97wdq"]
Sep 10 11:43:36.420544 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:43:36.420461    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="983d0d34-e61d-435f-978a-b2e4c1d56d92" path="/var/lib/kubelet/pods/983d0d34-e61d-435f-978a-b2e4c1d56d92/volumes"
Sep 10 11:44:36.901619 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.901588    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-686898fd-4lfc2"]
Sep 10 11:44:36.902001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.901966    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea41d90-3334-49f1-8577-18c5abfd244f" containerName="maas-api"
Sep 10 11:44:36.902001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.901978    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea41d90-3334-49f1-8577-18c5abfd244f" containerName="maas-api"
Sep 10 11:44:36.902001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.901989    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b3e451-2e94-43b5-bdcc-8df50ef98d33" containerName="maas-api"
Sep 10 11:44:36.902001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.901994    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b3e451-2e94-43b5-bdcc-8df50ef98d33" containerName="maas-api"
Sep 10 11:44:36.902001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902002    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681d1a4f-fbb5-417b-bb15-bde1f3913bfc" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902008    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="681d1a4f-fbb5-417b-bb15-bde1f3913bfc" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902014    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1bca54-2023-43ce-a608-2523ce5577e7" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902018    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1bca54-2023-43ce-a608-2523ce5577e7" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902032    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983d0d34-e61d-435f-978a-b2e4c1d56d92" containerName="manager"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902036    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="983d0d34-e61d-435f-978a-b2e4c1d56d92" containerName="manager"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902047    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902051    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902106    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="62bb4c7c-1d08-4101-868b-5f1b6827a71b" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902114    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea41d90-3334-49f1-8577-18c5abfd244f" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902120    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c1bca54-2023-43ce-a608-2523ce5577e7" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902126    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b3e451-2e94-43b5-bdcc-8df50ef98d33" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902133    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="681d1a4f-fbb5-417b-bb15-bde1f3913bfc" containerName="maas-api"
Sep 10 11:44:36.902157 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.902138    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="983d0d34-e61d-435f-978a-b2e4c1d56d92" containerName="manager"
Sep 10 11:44:36.905265 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.905238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:36.910217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.910186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 11:44:36.910217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.910208    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 11:44:36.910407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.910258    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 11:44:36.910407 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.910211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qnv8w\""
Sep 10 11:44:36.920754 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:36.920734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686898fd-4lfc2"]
Sep 10 11:44:37.011996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.011963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-metrics-certs\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.012202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.012015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-webhook-cert\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.012202 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.012091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxzmk\" (UniqueName: \"kubernetes.io/projected/15b8d17d-924f-4402-af8a-4a065e3486fc-kube-api-access-rxzmk\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.113766 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.113715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-metrics-certs\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.113766 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.113776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-webhook-cert\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.114016 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.113824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxzmk\" (UniqueName: \"kubernetes.io/projected/15b8d17d-924f-4402-af8a-4a065e3486fc-kube-api-access-rxzmk\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.116224 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.116195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-webhook-cert\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.116338 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.116230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-metrics-certs\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.122923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.122890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxzmk\" (UniqueName: \"kubernetes.io/projected/15b8d17d-924f-4402-af8a-4a065e3486fc-kube-api-access-rxzmk\") pod \"maas-controller-686898fd-4lfc2\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") " pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.215733 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.215685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:37.492123 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.492091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686898fd-4lfc2"]
Sep 10 11:44:37.492812 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:44:37.492785    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b8d17d_924f_4402_af8a_4a065e3486fc.slice/crio-6d412ff74f7b941ca2f61d2efe0bfaf6271e8ce6fe3fbae260a609bc5fcd052f WatchSource:0}: Error finding container 6d412ff74f7b941ca2f61d2efe0bfaf6271e8ce6fe3fbae260a609bc5fcd052f: Status 404 returned error can't find the container with id 6d412ff74f7b941ca2f61d2efe0bfaf6271e8ce6fe3fbae260a609bc5fcd052f
Sep 10 11:44:37.494118 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:37.494096    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:44:38.360807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:38.360710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-4lfc2" event={"ID":"15b8d17d-924f-4402-af8a-4a065e3486fc","Type":"ContainerStarted","Data":"fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3"}
Sep 10 11:44:38.361166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:38.360804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-4lfc2" event={"ID":"15b8d17d-924f-4402-af8a-4a065e3486fc","Type":"ContainerStarted","Data":"6d412ff74f7b941ca2f61d2efe0bfaf6271e8ce6fe3fbae260a609bc5fcd052f"}
Sep 10 11:44:38.361166 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:38.360838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:38.383547 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:38.383473    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-686898fd-4lfc2" podStartSLOduration=1.898251712 podStartE2EDuration="2.383458284s" totalImagesPullingTime="485.206572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:44:38.381372932 +0000 UTC m=+1802.475574592" watchObservedRunningTime="2026-09-10 11:44:38.383458284 +0000 UTC m=+1802.477659976"
Sep 10 11:44:49.369046 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:49.369014    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:56.651401 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.651371    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686898fd-4lfc2"]
Sep 10 11:44:56.651793 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.651580    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-686898fd-4lfc2" podUID="15b8d17d-924f-4402-af8a-4a065e3486fc" containerName="manager" containerID="cri-o://fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3" gracePeriod=30
Sep 10 11:44:56.901592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.901514    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:56.991719 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.991692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-metrics-certs\") pod \"15b8d17d-924f-4402-af8a-4a065e3486fc\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") "
Sep 10 11:44:56.991874 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.991773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-webhook-cert\") pod \"15b8d17d-924f-4402-af8a-4a065e3486fc\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") "
Sep 10 11:44:56.991920 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.991878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxzmk\" (UniqueName: \"kubernetes.io/projected/15b8d17d-924f-4402-af8a-4a065e3486fc-kube-api-access-rxzmk\") pod \"15b8d17d-924f-4402-af8a-4a065e3486fc\" (UID: \"15b8d17d-924f-4402-af8a-4a065e3486fc\") "
Sep 10 11:44:56.993876 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.993845    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "15b8d17d-924f-4402-af8a-4a065e3486fc" (UID: "15b8d17d-924f-4402-af8a-4a065e3486fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:44:56.993987 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.993965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "15b8d17d-924f-4402-af8a-4a065e3486fc" (UID: "15b8d17d-924f-4402-af8a-4a065e3486fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:44:56.994029 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:56.993981    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b8d17d-924f-4402-af8a-4a065e3486fc-kube-api-access-rxzmk" (OuterVolumeSpecName: "kube-api-access-rxzmk") pod "15b8d17d-924f-4402-af8a-4a065e3486fc" (UID: "15b8d17d-924f-4402-af8a-4a065e3486fc"). InnerVolumeSpecName "kube-api-access-rxzmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:44:57.093174 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.093143    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-webhook-cert\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:44:57.093174 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.093171    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxzmk\" (UniqueName: \"kubernetes.io/projected/15b8d17d-924f-4402-af8a-4a065e3486fc-kube-api-access-rxzmk\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:44:57.093350 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.093180    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b8d17d-924f-4402-af8a-4a065e3486fc-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:44:57.462742 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.462709    2580 generic.go:356] "Generic (PLEG): container finished" podID="15b8d17d-924f-4402-af8a-4a065e3486fc" containerID="fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3" exitCode=0
Sep 10 11:44:57.462887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.462750    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-4lfc2"
Sep 10 11:44:57.462887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.462792    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-4lfc2" event={"ID":"15b8d17d-924f-4402-af8a-4a065e3486fc","Type":"ContainerDied","Data":"fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3"}
Sep 10 11:44:57.462887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.462840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-4lfc2" event={"ID":"15b8d17d-924f-4402-af8a-4a065e3486fc","Type":"ContainerDied","Data":"6d412ff74f7b941ca2f61d2efe0bfaf6271e8ce6fe3fbae260a609bc5fcd052f"}
Sep 10 11:44:57.462887 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.462866    2580 scope.go:117] "RemoveContainer" containerID="fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3"
Sep 10 11:44:57.472399 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.472381    2580 scope.go:117] "RemoveContainer" containerID="fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3"
Sep 10 11:44:57.472739 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:44:57.472719    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3\": container with ID starting with fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3 not found: ID does not exist" containerID="fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3"
Sep 10 11:44:57.472822 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.472749    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3"} err="failed to get container status \"fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3\": rpc error: code = NotFound desc = could not find container \"fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3\": container with ID starting with fb1d80c163b2726760b2f1a1b1b0782d31788c0f2b84581a04bcb8cc1f9fa1c3 not found: ID does not exist"
Sep 10 11:44:57.485720 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.485694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-686898fd-4lfc2"]
Sep 10 11:44:57.489800 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:57.489777    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-686898fd-4lfc2"]
Sep 10 11:44:58.342715 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.342679    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-686898fd-24lj6"]
Sep 10 11:44:58.343108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.343091    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b8d17d-924f-4402-af8a-4a065e3486fc" containerName="manager"
Sep 10 11:44:58.343108 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.343101    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b8d17d-924f-4402-af8a-4a065e3486fc" containerName="manager"
Sep 10 11:44:58.343197 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.343168    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b8d17d-924f-4402-af8a-4a065e3486fc" containerName="manager"
Sep 10 11:44:58.347829 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.347812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.354621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.354591    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qnv8w\""
Sep 10 11:44:58.354621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.354608    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 11:44:58.354621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.354610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 11:44:58.354621 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.354595    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 11:44:58.369649 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.369625    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686898fd-24lj6"]
Sep 10 11:44:58.419506 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.419480    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b8d17d-924f-4402-af8a-4a065e3486fc" path="/var/lib/kubelet/pods/15b8d17d-924f-4402-af8a-4a065e3486fc/volumes"
Sep 10 11:44:58.507757 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.507730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae14f339-60bd-467c-82ae-25f3d91c50d4-webhook-cert\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.507888 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.507785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf4x7\" (UniqueName: \"kubernetes.io/projected/ae14f339-60bd-467c-82ae-25f3d91c50d4-kube-api-access-xf4x7\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.507937 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.507917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae14f339-60bd-467c-82ae-25f3d91c50d4-metrics-certs\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.609240 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.609179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf4x7\" (UniqueName: \"kubernetes.io/projected/ae14f339-60bd-467c-82ae-25f3d91c50d4-kube-api-access-xf4x7\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.609351 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.609284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae14f339-60bd-467c-82ae-25f3d91c50d4-metrics-certs\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.609351 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.609311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae14f339-60bd-467c-82ae-25f3d91c50d4-webhook-cert\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.611856 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.611829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae14f339-60bd-467c-82ae-25f3d91c50d4-metrics-certs\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.611974 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.611832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae14f339-60bd-467c-82ae-25f3d91c50d4-webhook-cert\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.618564 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.618505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf4x7\" (UniqueName: \"kubernetes.io/projected/ae14f339-60bd-467c-82ae-25f3d91c50d4-kube-api-access-xf4x7\") pod \"maas-controller-686898fd-24lj6\" (UID: \"ae14f339-60bd-467c-82ae-25f3d91c50d4\") " pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.657583 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.657561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:58.931542 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:58.931507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-686898fd-24lj6"]
Sep 10 11:44:58.933229 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:44:58.933207    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae14f339_60bd_467c_82ae_25f3d91c50d4.slice/crio-44c8bf6e8c57846844816dc6796867a26ca28a116de667bb307c04b9d5056909 WatchSource:0}: Error finding container 44c8bf6e8c57846844816dc6796867a26ca28a116de667bb307c04b9d5056909: Status 404 returned error can't find the container with id 44c8bf6e8c57846844816dc6796867a26ca28a116de667bb307c04b9d5056909
Sep 10 11:44:59.475569 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:59.475472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-24lj6" event={"ID":"ae14f339-60bd-467c-82ae-25f3d91c50d4","Type":"ContainerStarted","Data":"3655c886219b886c7afb8c2c6fe0c97c33280729a2f445c44000beadc47a6078"}
Sep 10 11:44:59.475569 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:59.475543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-686898fd-24lj6" event={"ID":"ae14f339-60bd-467c-82ae-25f3d91c50d4","Type":"ContainerStarted","Data":"44c8bf6e8c57846844816dc6796867a26ca28a116de667bb307c04b9d5056909"}
Sep 10 11:44:59.475958 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:59.475595    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:44:59.498781 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:44:59.498732    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-686898fd-24lj6" podStartSLOduration=1.208259534 podStartE2EDuration="1.498706011s" totalImagesPullingTime="290.446477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:44:59.496477265 +0000 UTC m=+1823.590678924" watchObservedRunningTime="2026-09-10 11:44:59.498706011 +0000 UTC m=+1823.592907669"
Sep 10 11:45:10.483152 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:45:10.483123    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-686898fd-24lj6"
Sep 10 11:48:50.962807 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:50.962773    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"]
Sep 10 11:48:50.967195 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:50.967173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:50.978776 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:50.978752    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"]
Sep 10 11:48:51.139058 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.139023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad6d6d1d-82a8-4d58-8f59-28596b352828-maas-api-tls\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.139229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.139086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad6d6d1d-82a8-4d58-8f59-28596b352828-metrics-certs\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.139229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.139140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad6d6d1d-82a8-4d58-8f59-28596b352828-openshift-service-ca\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.139229 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.139171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxmkz\" (UniqueName: \"kubernetes.io/projected/ad6d6d1d-82a8-4d58-8f59-28596b352828-kube-api-access-nxmkz\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.240659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.240586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad6d6d1d-82a8-4d58-8f59-28596b352828-maas-api-tls\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.240659 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.240634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad6d6d1d-82a8-4d58-8f59-28596b352828-metrics-certs\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.240816 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.240685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad6d6d1d-82a8-4d58-8f59-28596b352828-openshift-service-ca\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.240864 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.240841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxmkz\" (UniqueName: \"kubernetes.io/projected/ad6d6d1d-82a8-4d58-8f59-28596b352828-kube-api-access-nxmkz\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.241401 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.241342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad6d6d1d-82a8-4d58-8f59-28596b352828-openshift-service-ca\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.243191 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.243166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad6d6d1d-82a8-4d58-8f59-28596b352828-maas-api-tls\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.243274 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.243252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad6d6d1d-82a8-4d58-8f59-28596b352828-metrics-certs\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.249642 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.249626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxmkz\" (UniqueName: \"kubernetes.io/projected/ad6d6d1d-82a8-4d58-8f59-28596b352828-kube-api-access-nxmkz\") pod \"maas-api-dc7dbf8c8-cpdrm\" (UID: \"ad6d6d1d-82a8-4d58-8f59-28596b352828\") " pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.278627 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.278605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:51.552297 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.552264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"]
Sep 10 11:48:51.553420 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:48:51.553392    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6d6d1d_82a8_4d58_8f59_28596b352828.slice/crio-13660e135c5cb197b034136225c363c591d706cf6407deb7ca85aeeacec87df0 WatchSource:0}: Error finding container 13660e135c5cb197b034136225c363c591d706cf6407deb7ca85aeeacec87df0: Status 404 returned error can't find the container with id 13660e135c5cb197b034136225c363c591d706cf6407deb7ca85aeeacec87df0
Sep 10 11:48:51.705386 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:51.705347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm" event={"ID":"ad6d6d1d-82a8-4d58-8f59-28596b352828","Type":"ContainerStarted","Data":"13660e135c5cb197b034136225c363c591d706cf6407deb7ca85aeeacec87df0"}
Sep 10 11:48:52.712422 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:52.712390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm" event={"ID":"ad6d6d1d-82a8-4d58-8f59-28596b352828","Type":"ContainerStarted","Data":"8610acf9fbd8e81306820af70f3296fa2cec0ba0c7a332d07a3ca2e7c3d21072"}
Sep 10 11:48:52.712940 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:52.712456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:48:52.734496 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:52.734454    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm" podStartSLOduration=2.288424831 podStartE2EDuration="2.734440406s" totalImagesPullingTime="446.015575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:48:52.732062917 +0000 UTC m=+2056.826264578" watchObservedRunningTime="2026-09-10 11:48:52.734440406 +0000 UTC m=+2056.828642064"
Sep 10 11:48:58.722647 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:48:58.722583    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dc7dbf8c8-cpdrm"
Sep 10 11:49:07.203823 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:07.203793    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"]
Sep 10 11:49:07.204201 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:07.203990    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp" podUID="7dfa90d7-b1ca-47a1-936a-045f9b4f5297" containerName="maas-api" containerID="cri-o://ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643" gracePeriod=30
Sep 10 11:49:08.452418 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.452394    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:49:08.492444 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.492413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-metrics-certs\") pod \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") "
Sep 10 11:49:08.492592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.492483    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-maas-api-tls\") pod \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") "
Sep 10 11:49:08.492592 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.492582    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ckpx\" (UniqueName: \"kubernetes.io/projected/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-kube-api-access-4ckpx\") pod \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") "
Sep 10 11:49:08.492705 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.492690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-openshift-service-ca\") pod \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\" (UID: \"7dfa90d7-b1ca-47a1-936a-045f9b4f5297\") "
Sep 10 11:49:08.493120 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.493080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7dfa90d7-b1ca-47a1-936a-045f9b4f5297" (UID: "7dfa90d7-b1ca-47a1-936a-045f9b4f5297"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:49:08.494746 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.494718    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7dfa90d7-b1ca-47a1-936a-045f9b4f5297" (UID: "7dfa90d7-b1ca-47a1-936a-045f9b4f5297"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:49:08.494832 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.494769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7dfa90d7-b1ca-47a1-936a-045f9b4f5297" (UID: "7dfa90d7-b1ca-47a1-936a-045f9b4f5297"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:49:08.495076 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.495058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-kube-api-access-4ckpx" (OuterVolumeSpecName: "kube-api-access-4ckpx") pod "7dfa90d7-b1ca-47a1-936a-045f9b4f5297" (UID: "7dfa90d7-b1ca-47a1-936a-045f9b4f5297"). InnerVolumeSpecName "kube-api-access-4ckpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:49:08.593603 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.593523    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-openshift-service-ca\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:49:08.593603 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.593570    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-metrics-certs\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:49:08.593603 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.593579    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-maas-api-tls\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:49:08.593603 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.593587    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ckpx\" (UniqueName: \"kubernetes.io/projected/7dfa90d7-b1ca-47a1-936a-045f9b4f5297-kube-api-access-4ckpx\") on node \"ip-10-0-128-153.ec2.internal\" DevicePath \"\""
Sep 10 11:49:08.795760 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.795724    2580 generic.go:356] "Generic (PLEG): container finished" podID="7dfa90d7-b1ca-47a1-936a-045f9b4f5297" containerID="ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643" exitCode=0
Sep 10 11:49:08.795860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.795771    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"
Sep 10 11:49:08.795860 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.795817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp" event={"ID":"7dfa90d7-b1ca-47a1-936a-045f9b4f5297","Type":"ContainerDied","Data":"ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643"}
Sep 10 11:49:08.795962 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.795863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c55758554-jtxwp" event={"ID":"7dfa90d7-b1ca-47a1-936a-045f9b4f5297","Type":"ContainerDied","Data":"18921664793e67b24c00e345976dd75a32eeb14adcc65c3f33557a0df944af38"}
Sep 10 11:49:08.795962 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.795883    2580 scope.go:117] "RemoveContainer" containerID="ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643"
Sep 10 11:49:08.805663 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.805647    2580 scope.go:117] "RemoveContainer" containerID="ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643"
Sep 10 11:49:08.805910 ip-10-0-128-153 kubenswrapper[2580]: E0910 11:49:08.805893    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643\": container with ID starting with ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643 not found: ID does not exist" containerID="ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643"
Sep 10 11:49:08.805960 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.805918    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643"} err="failed to get container status \"ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643\": rpc error: code = NotFound desc = could not find container \"ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643\": container with ID starting with ef3a57b638a30880f216f09c0593451ae0a72a52184c44cfdd4d0aeec6e74643 not found: ID does not exist"
Sep 10 11:49:08.835884 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.835860    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"]
Sep 10 11:49:08.846923 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:08.846870    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c55758554-jtxwp"]
Sep 10 11:49:10.418937 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:10.418907    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfa90d7-b1ca-47a1-936a-045f9b4f5297" path="/var/lib/kubelet/pods/7dfa90d7-b1ca-47a1-936a-045f9b4f5297/volumes"
Sep 10 11:49:26.638934 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:26.638904    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cnsr6_d4024fc0-3810-4b7a-bc08-f8c573cd045b/manager/0.log"
Sep 10 11:49:26.916011 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:26.915917    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-686898fd-24lj6_ae14f339-60bd-467c-82ae-25f3d91c50d4/manager/0.log"
Sep 10 11:49:27.035806 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:27.035778    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rgcz6_bdff90f5-7430-49e8-bec3-4bc9e718373b/server/0.log"
Sep 10 11:49:27.168112 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:27.168030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7xcwn_61f8646c-a5b8-48c7-969e-da7db856f189/manager/0.log"
Sep 10 11:49:27.578688 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:27.578662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d6d6998d4-s557p_fb35081e-e25b-419a-a695-dfa9b3ceee3e/copy-manifests/0.log"
Sep 10 11:49:27.597824 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:27.597805    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d6d6998d4-s557p_fb35081e-e25b-419a-a695-dfa9b3ceee3e/manager/0.log"
Sep 10 11:49:28.067859 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:28.067837    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dc7dbf8c8-cpdrm_ad6d6d1d-82a8-4d58-8f59-28596b352828/maas-api/0.log"
Sep 10 11:49:28.423125 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:28.423052    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jbpqq_b10eed45-d7f4-4728-ad78-def1666c0ebf/postgres/0.log"
Sep 10 11:49:30.043768 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:30.043743    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-lfn7f_8cbc1cfd-7a13-4820-8947-c0ffea5cae00/manager/0.log"
Sep 10 11:49:30.550351 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:30.550318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-888xd_13bb33a4-0bca-495c-b492-46362f1f4740/discovery/0.log"
Sep 10 11:49:30.697325 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:30.697298    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4449d5c7-kgz46_2f33cf6c-87f9-45b0-92a3-893e855587c9/kube-auth-proxy/0.log"
Sep 10 11:49:31.089205 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:31.089179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2cjnv_6cc4fcfd-fca7-4bf9-8234-a7d0291e9529/payload-pre-processing/0.log"
Sep 10 11:49:31.221177 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:31.221153    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-tpc7d_84b23144-10e7-49e3-87d8-bbac53e8f183/payload-processing/0.log"
Sep 10 11:49:31.346910 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:31.346846    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-664cd9c55b-hvdjv_9e1c0235-f667-482e-9f74-d827f103045a/router/0.log"
Sep 10 11:49:31.822551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:31.822504    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-m5zln_fe848940-a11c-41d6-8258-bed5acfbf5ca/main/0.log"
Sep 10 11:49:32.080169 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:32.080092    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mmc47_b71f0978-9676-49e7-b819-2db3e06a4b41/main/0.log"
Sep 10 11:49:32.212030 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:32.212006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx655z_050f541d-ce4b-4484-b2b9-0fd0b97b516e/main/0.log"
Sep 10 11:49:41.268468 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:41.268438    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fr9t7_54710b21-c748-4242-b8fc-384aae38a017/global-pull-secret-syncer/0.log"
Sep 10 11:49:41.378354 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:41.378330    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fsnfx_f91d522e-b66a-4cbc-9bf1-d54ef38af245/konnectivity-agent/0.log"
Sep 10 11:49:41.435061 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:41.435040    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-153.ec2.internal_3788e9231500bda50f3f039c32df10fd/haproxy/0.log"
Sep 10 11:49:46.421635 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:46.421571    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-lfn7f_8cbc1cfd-7a13-4820-8947-c0ffea5cae00/manager/0.log"
Sep 10 11:49:47.917326 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:47.917298    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/alertmanager/0.log"
Sep 10 11:49:47.945844 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:47.945823    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/config-reloader/0.log"
Sep 10 11:49:47.972267 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:47.972246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/kube-rbac-proxy-web/0.log"
Sep 10 11:49:47.996373 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:47.996331    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/kube-rbac-proxy/0.log"
Sep 10 11:49:48.025120 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.025101    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/kube-rbac-proxy-metric/0.log"
Sep 10 11:49:48.060642 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.060620    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/prom-label-proxy/0.log"
Sep 10 11:49:48.085217 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.085199    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da55f3e6-f1b5-4970-948b-70cd0fa44b51/init-config-reloader/0.log"
Sep 10 11:49:48.184585 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.184510    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mg5tt_690ab962-165f-46df-b274-fe427b871438/kube-state-metrics/0.log"
Sep 10 11:49:48.204099 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.204067    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mg5tt_690ab962-165f-46df-b274-fe427b871438/kube-rbac-proxy-main/0.log"
Sep 10 11:49:48.230476 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.230444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mg5tt_690ab962-165f-46df-b274-fe427b871438/kube-rbac-proxy-self/0.log"
Sep 10 11:49:48.261006 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.260984    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d8bbc85cc-lvttc_0961b4eb-2ba2-4699-8b24-fc088cab304f/metrics-server/0.log"
Sep 10 11:49:48.331118 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.331095    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29dkv_37c48dc5-5744-4020-9d81-fe975db47f23/node-exporter/0.log"
Sep 10 11:49:48.364464 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.364446    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29dkv_37c48dc5-5744-4020-9d81-fe975db47f23/kube-rbac-proxy/0.log"
Sep 10 11:49:48.395909 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.395892    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29dkv_37c48dc5-5744-4020-9d81-fe975db47f23/init-textfile/0.log"
Sep 10 11:49:48.653394 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.653361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-6xvkg_ac7ef078-963f-4b10-8593-92c5a9530731/kube-rbac-proxy-main/0.log"
Sep 10 11:49:48.679059 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.679037    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-6xvkg_ac7ef078-963f-4b10-8593-92c5a9530731/kube-rbac-proxy-self/0.log"
Sep 10 11:49:48.703693 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:48.703668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-6xvkg_ac7ef078-963f-4b10-8593-92c5a9530731/openshift-state-metrics/0.log"
Sep 10 11:49:49.064063 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:49.063966    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f7bd7995b-hlfzk_63cf7106-48f8-44d0-9ef3-bbfaf1d498db/telemeter-client/0.log"
Sep 10 11:49:49.099030 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:49.099001    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f7bd7995b-hlfzk_63cf7106-48f8-44d0-9ef3-bbfaf1d498db/reload/0.log"
Sep 10 11:49:49.131934 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:49.131909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f7bd7995b-hlfzk_63cf7106-48f8-44d0-9ef3-bbfaf1d498db/kube-rbac-proxy/0.log"
Sep 10 11:49:51.429550 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.429500    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"]
Sep 10 11:49:51.429952 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.429938    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfa90d7-b1ca-47a1-936a-045f9b4f5297" containerName="maas-api"
Sep 10 11:49:51.429996 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.429954    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfa90d7-b1ca-47a1-936a-045f9b4f5297" containerName="maas-api"
Sep 10 11:49:51.430051 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.430042    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfa90d7-b1ca-47a1-936a-045f9b4f5297" containerName="maas-api"
Sep 10 11:49:51.433397 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.433381    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.436679 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.436656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79gdg\"/\"kube-root-ca.crt\""
Sep 10 11:49:51.436818 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.436699    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79gdg\"/\"openshift-service-ca.crt\""
Sep 10 11:49:51.437802 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.437784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-79gdg\"/\"default-dockercfg-rl99x\""
Sep 10 11:49:51.444481 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.444462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"]
Sep 10 11:49:51.541254 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.541230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzkt\" (UniqueName: \"kubernetes.io/projected/74069d30-1fef-4b11-8314-a7619f044981-kube-api-access-lmzkt\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.541358 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.541264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-lib-modules\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.541358 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.541332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-sys\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.541440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.541379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-proc\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.541440 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.541413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-podres\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.641927 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.641904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-podres\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.641950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzkt\" (UniqueName: \"kubernetes.io/projected/74069d30-1fef-4b11-8314-a7619f044981-kube-api-access-lmzkt\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.641974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-lib-modules\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642038 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.642027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-sys\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642161 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.642057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-proc\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642161 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.642067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-podres\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642161 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.642150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-sys\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.642171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-lib-modules\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.642263 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.642182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74069d30-1fef-4b11-8314-a7619f044981-proc\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.651312 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.651284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzkt\" (UniqueName: \"kubernetes.io/projected/74069d30-1fef-4b11-8314-a7619f044981-kube-api-access-lmzkt\") pod \"perf-node-gather-daemonset-hh9tc\" (UID: \"74069d30-1fef-4b11-8314-a7619f044981\") " pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:51.743337 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:51.743312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:52.017338 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:52.017304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"]
Sep 10 11:49:52.018169 ip-10-0-128-153 kubenswrapper[2580]: W0910 11:49:52.018147    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod74069d30_1fef_4b11_8314_a7619f044981.slice/crio-d6bf783632ac30c4a6cf17ddcfb6240fdaaa582d6a747e0ef757163a0444f49e WatchSource:0}: Error finding container d6bf783632ac30c4a6cf17ddcfb6240fdaaa582d6a747e0ef757163a0444f49e: Status 404 returned error can't find the container with id d6bf783632ac30c4a6cf17ddcfb6240fdaaa582d6a747e0ef757163a0444f49e
Sep 10 11:49:52.050974 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:52.050950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66748858d6-596pm_7f500394-0740-437d-8873-12fe29ef74d1/console/0.log"
Sep 10 11:49:52.813001 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:52.812962    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-cc5qc_55fc7c18-e7d6-45dd-a6db-a0d04f54cc97/volume-data-source-validator/0.log"
Sep 10 11:49:53.029262 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:53.029229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc" event={"ID":"74069d30-1fef-4b11-8314-a7619f044981","Type":"ContainerStarted","Data":"1bdd90a9ab7bbb94db34ee6d145ecc2fedd01b2938490fa61476e70051c17fe2"}
Sep 10 11:49:53.029416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:53.029279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc" event={"ID":"74069d30-1fef-4b11-8314-a7619f044981","Type":"ContainerStarted","Data":"d6bf783632ac30c4a6cf17ddcfb6240fdaaa582d6a747e0ef757163a0444f49e"}
Sep 10 11:49:53.029416 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:53.029317    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:49:53.054924 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:53.054883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc" podStartSLOduration=2.054868715 podStartE2EDuration="2.054868715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:49:53.052817844 +0000 UTC m=+2117.147019503" watchObservedRunningTime="2026-09-10 11:49:53.054868715 +0000 UTC m=+2117.149070373"
Sep 10 11:49:54.148492 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:54.148458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgbm6_5f0d4662-dcb8-480e-ab30-3464b4e8f41d/dns/0.log"
Sep 10 11:49:54.173431 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:54.173407    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgbm6_5f0d4662-dcb8-480e-ab30-3464b4e8f41d/kube-rbac-proxy/0.log"
Sep 10 11:49:54.236219 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:54.236197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cfmkf_06e98cfd-1f49-4a66-b727-8d91d2c64913/dns-node-resolver/0.log"
Sep 10 11:49:54.836475 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:54.836445    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5984f796bf-ml4mt_b5bc96fd-c39f-4e93-abd9-5d83fdbb2fac/registry/0.log"
Sep 10 11:49:54.922717 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:54.922683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w2fx8_9606b213-0b2a-436d-be69-c0666cc75f1f/node-ca/0.log"
Sep 10 11:49:56.366655 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:56.366622    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-888xd_13bb33a4-0bca-495c-b492-46362f1f4740/discovery/0.log"
Sep 10 11:49:56.390704 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:56.390673    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4449d5c7-kgz46_2f33cf6c-87f9-45b0-92a3-893e855587c9/kube-auth-proxy/0.log"
Sep 10 11:49:56.513551 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:56.513504    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2cjnv_6cc4fcfd-fca7-4bf9-8234-a7d0291e9529/payload-pre-processing/0.log"
Sep 10 11:49:56.562016 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:56.561988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-tpc7d_84b23144-10e7-49e3-87d8-bbac53e8f183/payload-processing/0.log"
Sep 10 11:49:56.592936 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:56.592909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-664cd9c55b-hvdjv_9e1c0235-f667-482e-9f74-d827f103045a/router/0.log"
Sep 10 11:49:57.626331 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:57.626297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9p7nx_0e7eab7c-03a7-472d-93ba-083772a05e1a/serve-healthcheck-canary/0.log"
Sep 10 11:49:58.272763 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:58.272732    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gzw4r_af3eb8cb-e235-4be2-95d9-1c6bb135c392/kube-rbac-proxy/0.log"
Sep 10 11:49:58.302943 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:58.302916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gzw4r_af3eb8cb-e235-4be2-95d9-1c6bb135c392/exporter/0.log"
Sep 10 11:49:58.328898 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:58.328874    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gzw4r_af3eb8cb-e235-4be2-95d9-1c6bb135c392/extractor/0.log"
Sep 10 11:49:59.044955 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:49:59.044927    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-79gdg/perf-node-gather-daemonset-hh9tc"
Sep 10 11:50:00.906919 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:00.906848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cnsr6_d4024fc0-3810-4b7a-bc08-f8c573cd045b/manager/0.log"
Sep 10 11:50:01.208386 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:01.208357    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-686898fd-24lj6_ae14f339-60bd-467c-82ae-25f3d91c50d4/manager/0.log"
Sep 10 11:50:01.233154 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:01.233133    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rgcz6_bdff90f5-7430-49e8-bec3-4bc9e718373b/server/0.log"
Sep 10 11:50:01.364797 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:01.364768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7xcwn_61f8646c-a5b8-48c7-969e-da7db856f189/manager/0.log"
Sep 10 11:50:01.762925 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:01.762848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d6d6998d4-s557p_fb35081e-e25b-419a-a695-dfa9b3ceee3e/manager/0.log"
Sep 10 11:50:01.792645 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:01.792617    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d6d6998d4-s557p_fb35081e-e25b-419a-a695-dfa9b3ceee3e/copy-manifests/0.log"
Sep 10 11:50:02.421721 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:02.421692    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-888xd_13bb33a4-0bca-495c-b492-46362f1f4740/discovery/0.log"
Sep 10 11:50:02.443088 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:02.443061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4449d5c7-kgz46_2f33cf6c-87f9-45b0-92a3-893e855587c9/kube-auth-proxy/0.log"
Sep 10 11:50:02.532508 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:02.532475    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2cjnv_6cc4fcfd-fca7-4bf9-8234-a7d0291e9529/payload-pre-processing/0.log"
Sep 10 11:50:02.585628 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:02.585608    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-tpc7d_84b23144-10e7-49e3-87d8-bbac53e8f183/payload-processing/0.log"
Sep 10 11:50:02.605670 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:02.605650    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-664cd9c55b-hvdjv_9e1c0235-f667-482e-9f74-d827f103045a/router/0.log"
Sep 10 11:50:04.613938 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:04.613906    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-888xd_13bb33a4-0bca-495c-b492-46362f1f4740/discovery/0.log"
Sep 10 11:50:04.666777 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:04.666751    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4449d5c7-kgz46_2f33cf6c-87f9-45b0-92a3-893e855587c9/kube-auth-proxy/0.log"
Sep 10 11:50:04.755397 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:04.755368    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2cjnv_6cc4fcfd-fca7-4bf9-8234-a7d0291e9529/payload-pre-processing/0.log"
Sep 10 11:50:04.798593 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:04.798569    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-tpc7d_84b23144-10e7-49e3-87d8-bbac53e8f183/payload-processing/0.log"
Sep 10 11:50:04.817154 ip-10-0-128-153 kubenswrapper[2580]: I0910 11:50:04.817129    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-664cd9c55b-hvdjv_9e1c0235-f667-482e-9f74-d827f103045a/router/0.log"